Finding the pdf of a transformed univariate random variable

  • #1
Hamiltonian
296
190
TL;DR Summary
Confused as to how to obtain the cdf of a transformed random variable.
1701139076070.png

The above theorem is trying to find the pdf of a transformed random variable, it attempts to do so by "first principles", starting by using the definition of cdf, I don't understand why they have a ##f_X(x)## in the integral wouldn't ##\int_{\{x:r(x)<y\}}r(X) dx## be the correct integral for the cdf of Y.
 
Physics news on Phys.org
  • #2
No. The way ##r(x)## gets into the equation is only in the limit of the integral, ##r(x) \lt y##. Suppose ##r(x) \lt y##. What is the probability (density) of that? It is the probability (density) of that associated ##x## value, which is ##f_X(x)##. So those are the probabilities that we want to total for the integral. (Notice that the integral is with respect to ##dx##, not ##dy##)

PS. I may have ignored the situation where multiple ##x## values give the same ##r(x)##. That still works out because the integral limit allows the associated ##x## densities to be summed
 
Last edited:
  • #3
Suppose ##Y=f(X)## and we know the pdf of X. To get the pdf of Y, we can find the CDF of Y ##P(Y<y)## then differentiate it wrt to y to get the pdf.
$$P(Y<y)=P(f(X)<y)$$
And depending on X you have to do an appropriate manipulation to get the cdf of Y. Here's and example, deriving the pdf of a ##\chi^2## function with a deg of freedom of one. This variable here is just ##Z^2##, Z is a standard normal distribution. The pdf of Z is a bit complex but you can find it here.
https://www.thoughtco.com/normal-distribution-bell-curve-formula-3126278 lets call this function f(x).
And cdf of f is ##\int_{-\infty}^{x}f(x) dx## and called F(x). Let X be a standard normal variable, and ##\chi=X^2##. So
$$P(\chi<y)=P(-\sqrt{y}<X<\sqrt{y})$$
which is ##F(\sqrt{y})-F(-\sqrt{y}## differentiating wrt y
$$P(\chi=y)\frac{1}{2\sqrt{y}} f(\sqrt{y})+\frac{1}{2\sqrt{y}} f(\sqrt{y})=\frac{1}{\sqrt{y}} f(\sqrt{y})$$
 
  • #4
Apologies the website gave gives the formula for the general normal distribution for the standard normal, take ##\sigma=1,\mu=0## in the equation
 

What is a probability density function (pdf)?

A probability density function (pdf) is a function that describes the likelihood of a random variable to take on a given value. The value of the pdf at any given point in the variable's range can be interpreted as providing a relative likelihood that the value of the random variable equals that sample.

How do you find the pdf of a transformed random variable?

To find the pdf of a transformed random variable, if \( Y = g(X) \) where \( X \) is a random variable with a known pdf and \( g \) is a function, you can use the formula \( f_Y(y) = f_X(g^{-1}(y)) \left|\frac{d}{dy}g^{-1}(y)\right| \), assuming \( g \) is a monotonic function. This involves finding the inverse of \( g \), differentiating it, and substituting into the formula along with the pdf of \( X \).

What does it mean for a function to be monotonic, and why is it important in finding the pdf of a transformed variable?

A function is monotonic if it is either entirely non-increasing or non-decreasing throughout its domain. This property is crucial for finding the pdf of a transformed variable because it ensures the function has an inverse, which is a key component in the change of variables formula used to find the new pdf.

What if the transformation function is not monotonic?

If the transformation function is not monotonic, the method becomes more complex as the function may not have a global inverse. In such cases, you need to segment the range into intervals where the function is monotonic, find the inverse in each segment, and sum the contributions to the pdf from each segment using the formula for monotonic transformations.

How do you handle transformations involving more than one random variable?

For transformations involving more than one random variable, you use the multivariate change of variables theorem. This involves the Jacobian matrix, which is the matrix of all first-order partial derivatives of the transformation functions. The pdf of the transformed variables is given by the product of the original pdf and the absolute determinant of the Jacobian matrix evaluated at the inverse of the transformation.

Similar threads

  • Set Theory, Logic, Probability, Statistics
Replies
4
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
16
Views
2K
  • Set Theory, Logic, Probability, Statistics
Replies
2
Views
3K
  • Set Theory, Logic, Probability, Statistics
Replies
6
Views
4K
  • Set Theory, Logic, Probability, Statistics
Replies
12
Views
2K
  • Set Theory, Logic, Probability, Statistics
Replies
10
Views
5K
  • Set Theory, Logic, Probability, Statistics
Replies
5
Views
5K
  • Set Theory, Logic, Probability, Statistics
Replies
6
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
1
Views
107
  • Set Theory, Logic, Probability, Statistics
Replies
4
Views
1K
Back
Top