Transformation of a random variable (exponential)

Click For Summary
SUMMARY

The discussion centers on the transformation of a random variable, specifically the distribution of \( Y = F(X) \) where \( X \sim \text{Exp}(\lambda) \). Participants clarify that the cumulative distribution function (CDF) of an exponential random variable is \( F(x) = 1 - e^{-\lambda x} \) and confirm that \( P[Y \le y] = P[X \le F^{-1}(y)] \). The inverse CDF is derived as \( F^{-1}(y) = -\frac{\ln(1-y)}{\lambda} \) for \( y \in [0, 1) \), leading to the conclusion that the distribution of \( Y \) is uniform on the interval \( (0, 1) \).

PREREQUISITES
  • Understanding of exponential distributions and their properties.
  • Familiarity with cumulative distribution functions (CDF) and probability density functions (PDF).
  • Knowledge of inverse functions and their applications in probability.
  • Basic calculus, particularly in evaluating limits and logarithmic functions.
NEXT STEPS
  • Study the properties of the exponential distribution in detail, focusing on its CDF and PDF.
  • Learn about transformations of random variables and their implications in probability theory.
  • Explore the concept of uniform distributions and how they relate to transformed variables.
  • Investigate the application of inverse functions in statistical analysis and probability calculations.
USEFUL FOR

Statisticians, data scientists, and students in probability theory who are interested in understanding random variable transformations and their distributions.

Jameson
Insights Author
Gold Member
MHB
Messages
4,533
Reaction score
13
Problem: Suppose that $X \text{ ~ Exp}(\lambda)$ and denote its distribution function by $F$. What is the distribution of $Y=F(X)$?

My attempt: First off, I'm assuming this is asking for the CDF of $Y$. Sometimes it's not clear what terminology refers to the PDF or the CDF for me.

$P[Y \le y]= P[F(X) \le y]= P[X \le F^{-1}(y)]$

For $x \ge 0$ the CDF of the exponential distribution is $1-e^{-\lambda x}$. So do I need to find the inverse of this and go from there? I have a feeling this is the right direction or this problem is trivially simple.
 
Physics news on Phys.org
I've found the inverse of $F(X)$. It is $$F^{-1}(X)=-\frac{\ln(1-x)}{\lambda}$$

From my OP, we have: $$P[Y \le y]= P[F(X) \le y]= P[X \le F^{-1}(y)]=P \left[X \le -\frac{\ln(1-y)}{\lambda} \right]$$

This inverse is only defined though for $y<1$. Is that all? I feel like I'm missing something.
 
Last edited:
It's ambiguous for me as well.
The use of capitals suggests the cumulative distribution function is intended.
It would be nice if they made that explicit.

Anyway, I think it is a bit of a trick question, since the function is decreasing.
That has some impact on the inequalities...

And you didn't give a final formula.
 
I like Serena said:
It's ambiguous for me as well.
The use of capitals suggests the cumulative distribution function is intended.
It would be nice if they made that explicit.

Anyway, I think it is a bit of a trick question, since the function is decreasing.
That has some impact on the inequalities...

And you didn't give a final formula.

The density of an exponential random variable is decreasing but the CDF isn't. The CDF is our $Y$.

What final formula? I think it should be $$-\frac{\ln(1-y)}{\lambda}$$ for $y \in [-\infty,1)$.
 
Jameson said:
The density of an exponential random variable is decreasing but the CDF isn't. The CDF is our $Y$.

The CDF is $F(x)=1-e^{-\lambda x}$.
Isn't that a decreasing function?

What final formula? I think it should be $$-\frac{\ln(1-y)}{\lambda}$$ for $y \in [-\infty,1)$.

You ended with $F_Y(y) = P(X \le \text{some expression})$.
But $P(X \le x) = 1-e^{-\lambda x}$.
Doesn't that mean there is some more work to do?
 
I like Serena said:
The CDF is $F(x)=1-e^{-\lambda x}$.
Isn't that a decreasing function?

I still say no. All CDFs must be increasing or non-decreasing. They must satisfy the property that $$\lim_{x \rightarrow -\infty}F(x)=0$$ and $$\lim_{x \rightarrow \infty}F(x)=1$$. Plus if you look at a graph of it you can see that it is increasing and has a ceiling of 1.

You ended with $F_Y(y) = P(X \le \text{some expression})$.
But $P(X \le x) = 1-e^{-\lambda x}$.
Doesn't that mean there is some more work to do?

Hmm, I thought of it like:

$$P[Y \le y]=P \left[ X \le \displaystyle -\frac{\ln(1-y)}{\lambda}\right]$$

Where should I head from here?:confused:
 
Jameson said:
I still say no. All CDFs must be increasing or non-decreasing. They must satisfy the property that $$\lim_{x \rightarrow -\infty}F(x)=0$$ and $$\lim_{x \rightarrow \infty}F(x)=1$$. Plus if you look at a graph of it you can see that it is increasing and has a ceiling of 1.

My mistake. You are right.

Hmm, I thought of it like:

$$P[Y \le y]=P \left[ X \le \displaystyle -\frac{\ln(1-y)}{\lambda}\right]$$

Where should I head from here?

$$P[ X \le \text{some expression}] = 1 - e^{-\lambda \cdot (\text{some expression})}$$
 
$$P[X \le F^{-1}(y)]=1-e^{-Ax}$$, where $$A=-\frac{\ln(1-y)}{\lambda}$$?

EDIT: No, that isn't right. I think I'm just supposed to evaluate $$F^{-1}(y)$$.
 
Jameson said:
$$P[X \le F^{-1}(y)]=1-e^{-Ax}$$, where $$A=-\frac{\ln(1-y)}{\lambda}$$?

That should be $$1-e^{-\lambda A}$$.
 
  • #10
I like Serena said:
That should be $$1-e^{-\lambda A}$$.

Agreed, however I still don't see how that is equal to $F^{-1}(y)$. The above seems to be $F\left( F^{-1}(y) \right)$
 
  • #11
Jameson said:
Agreed, however I still don't see how that is equal to $F^{-1}(y)$.

It isn't. :confused:

$A=F^{-1}(y)$

The above seems to be $F\left( F^{-1}(y) \right)$

Neat! Isn't it? ;)
 
  • #12
I just don't see how you get from $$F^{-1}(y)$$ to $$F\left( F^{-1}(y) \right)$$.

We start with $$P[X \le F^{-1}(y)]$$ and end up with $$P[X \le F\left( F^{-1}(y) \right)$$. Can you explain how we can make that jump?

Wait! I think I might have answered my own question. The definition of $F(X)=P[X \le x]$ so we just use that definition correct?

$$P[X \le F^{-1}(y)] = F\left( F^{-1}(y) \right)$$
 
  • #13
Jameson said:
I just don't see how you get from $$F^{-1}(y)$$ to $$F\left( F^{-1}(y) \right)$$.

We start with $$P[X \le F^{-1}(y)]$$ and end up with $$P[X \le F\left( F^{-1}(y) \right)$$. Can you explain how we can make that jump?

Wait! I think I might have answered my own question. The definition of $F(X)=P[X \le x]$ so we just use that definition correct?

$$P[X \le F^{-1}(y)] = F\left( F^{-1}(y) \right)$$

Yep!
 
  • #14
I like Serena said:
Yep!

Awesome. Thank you! I didn't feel very good about transformations before but now I feel much more confident.
 
  • #15
Something I didn't notice before was that $$P[X \le F^{-1}(y)] = F\left( F^{-1}(y) \right)$$ simplifies to $y$. Does that mean that the distribution of $Y$ is $y$?

EDIT: I think the only other thing is to describe the bounds. For the exponential distribution the CDF is non-zero for $x \ge 0$ and 0 for $x<0$. I think that means in terms of $Y$ the CDF is $y$, where $0 < y <1$.
 
Last edited:

Similar threads

  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 30 ·
2
Replies
30
Views
4K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 6 ·
Replies
6
Views
5K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 8 ·
Replies
8
Views
2K
  • · Replies 1 ·
Replies
1
Views
1K
  • · Replies 16 ·
Replies
16
Views
3K
  • · Replies 1 ·
Replies
1
Views
1K
  • · Replies 4 ·
Replies
4
Views
2K