Delta method fails. Any suggestions how to calculate E(Y)?

Click For Summary

Discussion Overview

The discussion revolves around calculating the expected value of a non-standard random variable Y defined as Y = Z^2*exp(Z)/(1 + exp(Z))^2, where Z is a normally distributed random variable. Participants explore various methods for finding E(Y), including the delta method, simulations, and potential approximations, while expressing uncertainty about the existence of a satisfactory solution.

Discussion Character

  • Exploratory
  • Technical explanation
  • Debate/contested

Main Points Raised

  • One participant notes that the delta method fails due to accumulating errors and seeks alternative approaches.
  • Another participant suggests using simulations to estimate E(Y) instead of seeking an analytical solution, providing R code for implementation.
  • A participant expresses a desire for an approximation rather than a numerical solution, indicating that Y exhibits a symmetric bimodal distribution when plotted.
  • There is a proposal to consider using the square root of a chi-square distribution as a substitute for the normal distribution, which is argued to be more suitable for the problem.
  • One participant questions the validity of the assumption that E(Y) = 0 based on the symmetry of Y(Z) and Z's distribution, but later expresses doubt about this assumption after running simulations.
  • Another participant clarifies that while Y(Z) = Y(-Z) holds, it does not imply that E(Y) = 0, as a different condition would be required for that conclusion.

Areas of Agreement / Disagreement

Participants do not reach a consensus on the best method to calculate E(Y). There are multiple competing views regarding the use of simulations, approximations, and the implications of symmetry in the distribution of Y.

Contextual Notes

Participants acknowledge the absence of an exact analytical solution and express uncertainty about the effectiveness of various proposed methods, including the delta method and Padé approximation. The discussion also highlights the complexity of the distribution of Y and its implications for calculating the expected value.

Hejdun
Messages
25
Reaction score
0
Hi,

Let Z be a r.v. from N(0, σ^2) and let Y = Z^2*exp(Z)/(1 + exp(Z))^2.
What is the exptected value of Y, E(Y)?

The delta method (Taylor expansion) doesn't work since
the errors seem to accumulate.

Any suggestions? This is a non-standard problem related to my research and I am totally stuck with this one...

// H
 
Last edited:
Physics news on Phys.org
Hejdun said:
Hi,

Let Z be a r.v. from N(0, σ^2) and let Y = Z^2*exp(Z)/(1 + exp(Z))^2.
What is the exptected value of Y, E(Y)?

The delta method (Taylor expansion) doesn't work since
the errors seem to accumulate.

Any suggestions? This is a non-standard problem related to my research and I am totally stuck with this one...

// H

Hey Hejdun and welcome to the forums.

If it's hard to get an analytic answer for the distribution, you should do a simulation and then create a simulated distribution for Y in which you can can easily calculate E[Y].

I would use R to do this: it's free and it would take you probably ten minutes to get this result up on screen.

The commands you need to use

z = rnorm(10000,0,sd=whatever) and then y = z^2*exp(z)/(1 + exp(z))^2 and then mean(y). It should take only ten seconds or less to execute.
 
chiro said:
Hey Hejdun and welcome to the forums.

If it's hard to get an analytic answer for the distribution, you should do a simulation and then create a simulated distribution for Y in which you can can easily calculate E[Y].

I would use R to do this: it's free and it would take you probably ten minutes to get this result up on screen.

The commands you need to use

z = rnorm(10000,0,sd=whatever) and then y = z^2*exp(z)/(1 + exp(z))^2 and then mean(y). It should take only ten seconds or less to execute.


Thanks for your help. However, I am not looking for a numerical solution. I am aware of that no exact analytical solution exists, but maybe there is some approximation that is "good enough".

If you plot the function in R, then it is clear that Y=f(Z) is a symmetric bimodal distribution. Perhaps it simplifies if we put a restriction and look at Y when Z>0.

But anyway, I am stuck right now. Perhaps not solution exist.
 
Hejdun said:
Thanks for your help. However, I am not looking for a numerical solution. I am aware of that no exact analytical solution exists, but maybe there is some approximation that is "good enough".

If you plot the function in R, then it is clear that Y=f(Z) is a symmetric bimodal distribution. Perhaps it simplifies if we put a restriction and look at Y when Z>0.

But anyway, I am stuck right now. Perhaps not solution exist.

Instead of using a normal, why don't you use the square root of a chi-square. This distribution will act like a positive normal distribution and is only defined from 0 onwards.
 
chiro said:
Instead of using a normal, why don't you use the square root of a chi-square. This distribution will act like a positive normal distribution and is only defined from 0 onwards.

Thanks again for you interest in my problem and your suggestions.
However, I am not sure how your suggestion in this case would help. What chi-square distribution and how many degrees of freedom?

BTW, I tried doing a Padé Approximation instead of Taylor expansion, but that didn't help either.

/H
 
Since Y(Z) = Y(-Z) and Z's distribution is symmetric about 0, doesn't this imply that E(Y) = 0?
 
awkward said:
Since Y(Z) = Y(-Z) and Z's distribution is symmetric about 0, doesn't this imply that E(Y) = 0?

Thanks for your answer.

That is true. I think the assumption Y(Z)=Y(-Z) could be wrong however (even though they are very similar), since when I run simulations to check E(Y) then E(Y) ≠ 0.
 
Hejdun said:
Thanks for your help. However, I am not looking for a numerical solution. I am aware of that no exact analytical solution exists, but maybe there is some approximation that is "good enough".
I don't understand this. Why can't a numerical solution be "good enough"?
 
Hurkyl said:
I don't understand this. Why can't a numerical solution be "good enough"?

Because this expectation is a part of a larger derivation of a proof and needs to be more general.

But thanks for you comment.
 
  • #10
Hejdun said:
Thanks for your answer.

That is true. I think the assumption Y(Z)=Y(-Z) could be wrong however (even though they are very similar), since when I run simulations to check E(Y) then E(Y) ≠ 0.
It's not an assumption, it's an identity. See if you can prove it.

[edit] Oops... Although it's true that Y(Z) = Y(-Z), unfortunately that's not what you would need to get a mean of zero. For that you would need Y(Z) = -Y(Z). So please ignore what I wrote. [/edit]
 
Last edited:

Similar threads

  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 33 ·
2
Replies
33
Views
7K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 1 ·
Replies
1
Views
4K
  • · Replies 3 ·
Replies
3
Views
3K
Replies
1
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 19 ·
Replies
19
Views
4K
  • · Replies 4 ·
Replies
4
Views
2K