Delta method fails. Any suggestions how to calculate E(Y)?

Click For Summary
SUMMARY

The discussion revolves around calculating the expected value E(Y) for the function Y = Z^2*exp(Z)/(1 + exp(Z))^2, where Z is a random variable from N(0, σ^2). The delta method fails to provide a solution due to error accumulation. Participants suggest using simulation in R to approximate E[Y] and discuss alternative approaches, including the use of a chi-square distribution and Padé Approximation, but no satisfactory analytical solution is found.

PREREQUISITES
  • Understanding of random variables and probability distributions, specifically normal distributions.
  • Familiarity with the delta method and Taylor expansion in statistics.
  • Basic knowledge of R programming for statistical simulation.
  • Concept of chi-square distribution and its properties.
NEXT STEPS
  • Learn how to perform statistical simulations in R, specifically using the rnorm function.
  • Research the properties and applications of the chi-square distribution in statistical modeling.
  • Explore Padé Approximation techniques and their use in approximating functions.
  • Investigate the implications of symmetry in probability distributions and its effect on expected values.
USEFUL FOR

Researchers, statisticians, and data analysts who are dealing with complex probability distributions and require methods for calculating expected values in non-standard scenarios.

Hejdun
Messages
25
Reaction score
0
Hi,

Let Z be a r.v. from N(0, σ^2) and let Y = Z^2*exp(Z)/(1 + exp(Z))^2.
What is the exptected value of Y, E(Y)?

The delta method (Taylor expansion) doesn't work since
the errors seem to accumulate.

Any suggestions? This is a non-standard problem related to my research and I am totally stuck with this one...

// H
 
Last edited:
Physics news on Phys.org
Hejdun said:
Hi,

Let Z be a r.v. from N(0, σ^2) and let Y = Z^2*exp(Z)/(1 + exp(Z))^2.
What is the exptected value of Y, E(Y)?

The delta method (Taylor expansion) doesn't work since
the errors seem to accumulate.

Any suggestions? This is a non-standard problem related to my research and I am totally stuck with this one...

// H

Hey Hejdun and welcome to the forums.

If it's hard to get an analytic answer for the distribution, you should do a simulation and then create a simulated distribution for Y in which you can can easily calculate E[Y].

I would use R to do this: it's free and it would take you probably ten minutes to get this result up on screen.

The commands you need to use

z = rnorm(10000,0,sd=whatever) and then y = z^2*exp(z)/(1 + exp(z))^2 and then mean(y). It should take only ten seconds or less to execute.
 
chiro said:
Hey Hejdun and welcome to the forums.

If it's hard to get an analytic answer for the distribution, you should do a simulation and then create a simulated distribution for Y in which you can can easily calculate E[Y].

I would use R to do this: it's free and it would take you probably ten minutes to get this result up on screen.

The commands you need to use

z = rnorm(10000,0,sd=whatever) and then y = z^2*exp(z)/(1 + exp(z))^2 and then mean(y). It should take only ten seconds or less to execute.


Thanks for your help. However, I am not looking for a numerical solution. I am aware of that no exact analytical solution exists, but maybe there is some approximation that is "good enough".

If you plot the function in R, then it is clear that Y=f(Z) is a symmetric bimodal distribution. Perhaps it simplifies if we put a restriction and look at Y when Z>0.

But anyway, I am stuck right now. Perhaps not solution exist.
 
Hejdun said:
Thanks for your help. However, I am not looking for a numerical solution. I am aware of that no exact analytical solution exists, but maybe there is some approximation that is "good enough".

If you plot the function in R, then it is clear that Y=f(Z) is a symmetric bimodal distribution. Perhaps it simplifies if we put a restriction and look at Y when Z>0.

But anyway, I am stuck right now. Perhaps not solution exist.

Instead of using a normal, why don't you use the square root of a chi-square. This distribution will act like a positive normal distribution and is only defined from 0 onwards.
 
chiro said:
Instead of using a normal, why don't you use the square root of a chi-square. This distribution will act like a positive normal distribution and is only defined from 0 onwards.

Thanks again for you interest in my problem and your suggestions.
However, I am not sure how your suggestion in this case would help. What chi-square distribution and how many degrees of freedom?

BTW, I tried doing a Padé Approximation instead of Taylor expansion, but that didn't help either.

/H
 
Since Y(Z) = Y(-Z) and Z's distribution is symmetric about 0, doesn't this imply that E(Y) = 0?
 
awkward said:
Since Y(Z) = Y(-Z) and Z's distribution is symmetric about 0, doesn't this imply that E(Y) = 0?

Thanks for your answer.

That is true. I think the assumption Y(Z)=Y(-Z) could be wrong however (even though they are very similar), since when I run simulations to check E(Y) then E(Y) ≠ 0.
 
Hejdun said:
Thanks for your help. However, I am not looking for a numerical solution. I am aware of that no exact analytical solution exists, but maybe there is some approximation that is "good enough".
I don't understand this. Why can't a numerical solution be "good enough"?
 
Hurkyl said:
I don't understand this. Why can't a numerical solution be "good enough"?

Because this expectation is a part of a larger derivation of a proof and needs to be more general.

But thanks for you comment.
 
  • #10
Hejdun said:
Thanks for your answer.

That is true. I think the assumption Y(Z)=Y(-Z) could be wrong however (even though they are very similar), since when I run simulations to check E(Y) then E(Y) ≠ 0.
It's not an assumption, it's an identity. See if you can prove it.

[edit] Oops... Although it's true that Y(Z) = Y(-Z), unfortunately that's not what you would need to get a mean of zero. For that you would need Y(Z) = -Y(Z). So please ignore what I wrote. [/edit]
 
Last edited:

Similar threads

  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 33 ·
2
Replies
33
Views
6K
Replies
1
Views
2K
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 14 ·
Replies
14
Views
2K
  • · Replies 3 ·
Replies
3
Views
3K
  • · Replies 13 ·
Replies
13
Views
3K
Replies
1
Views
1K
  • · Replies 16 ·
Replies
16
Views
3K
  • · Replies 4 ·
Replies
4
Views
2K