Question about a property of pdfs

  • Context: Graduate 
  • Thread starter Thread starter Obie
  • Start date Start date
  • Tags Tags
    Property
Click For Summary

Discussion Overview

The discussion revolves around properties of probability density functions (pdfs) and their expected values, particularly focusing on the relationship between two pdfs, fH(x) and fL(x), with the same support. Participants explore whether certain integrals involving these pdfs are greater than one under specific conditions, including first order stochastic dominance.

Discussion Character

  • Exploratory
  • Technical explanation
  • Debate/contested
  • Mathematical reasoning

Main Points Raised

  • Some participants propose that if the expected value of a random variable with pdf fL(x) is greater than that with pdf fH(x), then the integral INT{ (fH(x)^2)/fL(x) } dx may be larger than one, but this is not universally accepted.
  • Others argue that the claim regarding the integral's value may not hold true under all conditions, suggesting that counterexamples exist.
  • A participant suggests that if the CDF FH(x) is less than or equal to FL(x) for all x, this condition is sufficient for E[X1] < E[X2], but not necessary.
  • There is a proposal that the integral INT{ (fL(x)^2)/fH(x) } dx is also likely greater than one, based on a conjectured relationship between the two pdfs.
  • One participant outlines a proof suggesting that the integral of (f2^2)/f1 is greater than or equal to one, with further elaboration indicating that if the means differ, the integral is strictly greater than one.

Areas of Agreement / Disagreement

Participants express differing views on the validity of the claims regarding the integrals and their relationships to expected values. Some participants agree on certain mathematical properties, while others challenge the assumptions and conclusions drawn from them. The discussion remains unresolved regarding the general applicability of these properties.

Contextual Notes

Participants note that the conditions under which the integrals are evaluated may depend on specific assumptions about the pdfs and their relationships, including the nature of the perturbating function introduced in the proof outline.

Obie
Messages
5
Reaction score
0
I've encountered this question in some theoretical work I've been doing. Suppose you have two pdfs fH(x) and fL(x) with the same support (bounded or infinite... you can assume whatever you want about it).

Suppose that the expected value of a random variable with pdf fL(x) is greater than the expected value of a random variable with pdf fH(x).

Is it true that the integral over the common support INT{ (fH(x)^2)/fL(x) } dx is larger than one? Is it true if the CDF FH(x)<=FL(X)?

I've checked family of distributions x^a, exponential, Normal, binomial and the claim is true in these classes, but I don't know if its true in general...
 
Physics news on Phys.org
Obie said:
I've encountered this question in some theoretical work I've been doing. Suppose you have two pdfs fH(x) and fL(x) with the same support (bounded or infinite... you can assume whatever you want about it).

Suppose that the expected value of a random variable with pdf fL(x) is greater than the expected value of a random variable with pdf fH(x).

Is it true if the CDF FH(x)<=FL(X)?
You mean for all x right? In that case the answer is definitely no. I had no problems finding simple counter examples for this. (Can post one later if you wish, they're very easy to find).
Is it true that the integral over the common support INT{ (fH(x)^2)/fL(x) } dx is larger than one?
I pretty sure that the answer is yes, but be careful as this may not mean exactly what you're expecting it means. Note however that I also think that INT{ (fL(x)^2)/fH(x) } dx is larger than one as well! In fact I believe that for any given density function f1, that the density function f2 which minimizes the integral of f2(x)^2/f1(x) dx is f2 = f1. That means that for any two density functions that are not identical then your integral will be greater than unity, regardless of which one you put on the numerator and which one on the denominator.
 
Last edited:
Obie said:
Is it true if the CDF FH(x)<=FL(X)?

Hang on, are you actually asking if that inequality is true for the CDF evaluated at the mean or are you asking if it's true for all x as I assumed above?

Did you really mean to ask if the following is true.

F_H(\overline{x}_H) \leq F_L(\overline{x}_L)

Is that what you're asking?
 
Last edited:
Obie said:
Suppose that the expected value of a random variable with pdf fL(x) is greater than the expected value of a random variable with pdf fH(x).

Also did you mean that the other way around? As in "the expected value of a random variable with pdf fL(x) is less than the expected value of a random variable with pdf fH(x)".
 
Hi Uart.

Thanks for taking the time to reply. I apologize for the confusing phrasing of the question. Please allow me to rephrase the question in a more precse way.

Consider two Random Variables X1, X2, with the same support, for which E[X1]<E[X2]. Let the CDF of X1 be F1 and the cdf of X2 be F2, with pdfs f1, f2. Notice that if, F2(x)<=F1(x) for all x in the support, this is a sufficient, but not necessary condition for E[X1]<E[X2]. This is the property called first order stochastic dominance.

Question 1)

does E[X1]<E[X2] imply that the integral over the support of (f2(x)^2)/f1(x) is greater than 1?

It seems your answer is that the claim is true regrdless of the relationship between the expected values. This would be great. I would appreciate any further explanation. Did you set the problem up as a constrained optimization for one of the pdfs?

Question 2)
If the answer to question1) is no, then would the addition of the property of first order dominance make it true. That is, is it tru that if F2(x)<=F1(x) for all x in the support, (implies E[X1]<E[X2]) that the intgral of the previous ratio is larger than one.

Thanks so much for your help. Much appreciated.
 
Ok, here's a brief "outline proof" of that first conjecture.

Let f2 be the equal to f1 plus a perturbating function n(x),

f_2(x) = f_1(x) + n(x)

Integrating both sides shows that the integral of the perturbing function, n(x), must be zero ( since \int f_1 = 1 and \int f_2 = 1 ).

Substituting f2 = (f1 + n) into your integral gives,

\int \frac{f_2^2}{f_1} = \int f_2 + 2 \int n + \int \frac{n^2}{f_1}

= 1 + 0 + integral of non-negative function.

Therefore \int \frac{f_2^2}{f_1} \geq 1
 
Last edited:
BTW. Note that for finite functions that n must be non-zero at more than a finite number of points in order to make the two means differ. It follows therefore that the last part of the above integral (the part I referred to as "integral of nonnegative function") is strictly positive. In this case we can make the stronger statement that if the two means are different then,

\int \frac{f_2^2}{f_1} &gt; 1
 
Thamks so much. I guess I thought it was going to be more complicated than it actually is!
 

Similar threads

  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 0 ·
Replies
0
Views
2K
  • · Replies 8 ·
Replies
8
Views
3K
  • · Replies 10 ·
Replies
10
Views
2K
  • · Replies 9 ·
Replies
9
Views
3K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 16 ·
Replies
16
Views
3K