Validity of replacing X by E[X] in a formula

In summary, the conversation discusses a generalization of a theorem about Monte Carlo simulation, where the expected value of a random variable in the denominator of a fraction can be replaced with the actual value. The conversation also explores whether this result can be generalized further and if there are any similar results in analysis or probability theory. Additional premises may be needed to make the generalization work, such as the condition that the ratio of the standard deviation to the expected value of the random variable approaches 0.
  • #1
andrewkirk
Science Advisor
Homework Helper
Insights Author
Gold Member
4,119
1,716
Hello all. I am working on proving some theorems about Monte Carlo simulation and have proven a theorem that, in a certain formula, it is valid to replace a random variable in the denominator of a fraction by its expected value. I have been wondering whether this result can be generalised to obtain wider application.

A nice generalisation of the theorem would be as follows:

If ##(U_k)_{k\in \mathbb N}## and ##(V_k)_{k\in \mathbb N}## are sequences of random variables, not necessarily independent, and ##\lim_{k\to\infty}\frac{\sqrt{\mathrm{Var}(V_k)}}{E[V_k]}=0##, then
$$\lim_{k\to\infty}E\left[\frac{U_k}{V_k}\right]=\lim_{k\to\infty}\frac{E\left[U_k\right]}{E\left[V_k\right]}$$
provided the limit on the RHS exists. (##k## is the number of Monte Carlo trials)

Before setting out to try to work out whether this is correct and, if so, to prove it, I'd like to first check if anybody knows of any similar results from analysis or probability theory. While it would be fun to prove it from scratch, it's a bit peripheral to what I'm doing so, if there's a known result that validates it, it would be better to just use that.

There may be some additional premises needed in order to make it work.

Thank you in advance for any suggestions.
 
Physics news on Phys.org
  • #2
When A and B are independent, E(A/B)=E(A)E(1/B). In general E(1/B)≠1/E(B).
 
  • #3
mathman said:
When A and B are independent, E(A/B)=E(A)E(1/B). In general E(1/B)≠1/E(B).
Yes, that's part of the process I went through. A very simple example is when B has value 1 or 2, each with probability 50%. Then E[1/B]=3/4 and 1/E[ B ]=2/3. However, under certain constraints like those above (and maybe a few more - part of the problem is to work out which ones) that inequality can become an equality in the limit as ##k\to\infty##. In general, the numerator and denominator will not be independent, so we can't necessarily factor the expectation.
 
  • #4
The condition [itex]\frac{\sigma (V_k)}{E(V_k)} -> 0 [/itex] seems to lead to a constant distribution, as long as [itex]E(V_k)[/itex] is bounded. I suspect this is what you are looking for.
 

1. What does replacing X by E[X] mean in a formula?

Replacing X by E[X] in a formula means substituting the variable X with the expected value of X. This is often done in statistical calculations to simplify the formula and make it more accurate.

2. How do you determine the validity of replacing X by E[X] in a formula?

The validity of replacing X by E[X] in a formula depends on the nature of the data and the assumptions made in the formula. Generally, it is valid to replace X by E[X] if the data follows a normal distribution and the formula is based on statistical principles.

3. Can replacing X by E[X] affect the results of a formula?

Yes, replacing X by E[X] can affect the results of a formula. This is because the expected value of X may be different from the actual values of X in the data, which can alter the final outcome of the formula.

4. Are there any limitations to replacing X by E[X] in a formula?

One limitation of replacing X by E[X] in a formula is that it assumes the data follows a normal distribution and that the formula is based on statistical principles. If these assumptions are not met, the validity of replacing X by E[X] may be questioned.

5. What are some situations where replacing X by E[X] in a formula is not valid?

Replacing X by E[X] may not be valid when dealing with skewed or non-normal data, as the expected value may not accurately represent the data. It may also not be valid in formulas that do not follow statistical principles, such as some machine learning algorithms.

Similar threads

  • Atomic and Condensed Matter
Replies
1
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
2
Views
1K
Replies
1
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
9
Views
2K
  • Set Theory, Logic, Probability, Statistics
Replies
7
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
3
Views
854
  • Set Theory, Logic, Probability, Statistics
Replies
2
Views
1K
  • Calculus and Beyond Homework Help
Replies
6
Views
471
  • Set Theory, Logic, Probability, Statistics
Replies
8
Views
1K
  • Set Theory, Logic, Probability, Statistics
Replies
1
Views
4K
Back
Top