MHB How to calculate $E(X_iX_j)$ with $i\ne j$?

Click For Summary
SUMMARY

The discussion focuses on calculating the expectation of the square of the sum of independent random variables $X_1, X_2, \ldots, X_{10}$, each taking values $\pm 2$ with equal probability. The participants derive that $\mathbb{E}(S^2) = 20$ by applying the properties of expectation and independence. They clarify that the expectation of the product of different variables, $E(X_iX_j)$ for $i \ne j$, equals zero due to the independence of the variables. The final formula used is $E(S^2) = E(X_1^2) + ... + E(X_n^2) + 2 \sum_{i\ne j} E(X_iX_j)$.

PREREQUISITES
  • Understanding of random variables and their distributions
  • Knowledge of expectation and variance in probability theory
  • Familiarity with the properties of independent random variables
  • Basic algebraic manipulation of equations involving expectations
NEXT STEPS
  • Study the properties of independent random variables in probability theory
  • Learn about calculating expectations for sums of random variables
  • Explore the concept of variance and its relationship to expectation
  • Investigate the implications of covariance in the context of independent variables
USEFUL FOR

Students and professionals in statistics, data science, and mathematics who are interested in understanding the calculations of expectations and variances of random variables, particularly in the context of independent distributions.

mathmari
Gold Member
MHB
Messages
4,984
Reaction score
7
Hey! :o

The random variables $X_1, X_2, \ldots , X_{10}$ are independent and have the same distribution function and each of them gets exactly the values $\pm 2$ and with equal probability.

We define the random variable $S=X_1+X_2+\ldots +X_{10}$.

I want to calculate $\mathbb{E}(S^2)$.

Could you give me a hint how we could calculate that? I don't really have an idea. (Wondering)
 
Physics news on Phys.org
Hey mathmari! (Smile)

What is the expectation of $X_1$?
Of $X_1+X_2$?
Of $X_1^2$? (Wondering)
 
I like Serena said:
What is the expectation of $X_1$?
Of $X_1+X_2$?
Of $X_1^2$? (Wondering)

Do we have the following?

$\mathbb{E}(X_i)=x_i\cdot p=(\pm 2)\cdot \frac{1}{10}=\pm\frac{1}{5}$
$\mathbb{E}(X_i+X_j)=\mathbb{E}(X_i)+\mathbb{E}(X_j)$
$\mathbb{E}(X_i^2)=x_i^2\cdot p=(\pm 2)^2\cdot \frac{1}{10}=4\cdot \frac{1}{10}=\frac{2}{5}$

(Wondering)
 
Don't we have:
$$EY=\sum_j y_jp_j$$
(Wondering)
 
I like Serena said:
Don't we have:
$$EY=\sum_j y_jp_j$$
(Wondering)
So do we have $E(X_i)=-2\cdot \frac{1}{2}+2\cdot \frac{1}{2}=0$ ? Or do you mean something else?
 
mathmari said:
So do we have $E(X_i)=-2\cdot \frac{1}{2}+2\cdot \frac{1}{2}=0$ ? Or do you mean something else?

Yes, that's what I meant.
 
I like Serena said:
Yes, that's what I meant.
Great! Do we get then $$E(S^2)=\sum E(X_i^2)=\sum x_i^2\cdot p=\sum 4\cdot \frac{1}{2}=10\cdot 2=20$$?
 
mathmari said:
Great! Do we get then $$E(S^2)=\sum E(X_i^2)=\sum x_i^2\cdot p=\sum 4\cdot \frac{1}{2}=10\cdot 2=20$$?

Isn't $S^2\ne \sum X_i^2$? (Worried)
 
I like Serena said:
Isn't $S^2\ne \sum X_i^2$? (Worried)

Ah ok.. but what can we do in this case?
 
  • #10
mathmari said:
Ah ok.. but what can we do in this case?

I see the following possible approaches:

  1. Apply the definition of expectation directly.
    $$E(S^2) = \sum_j s_j^2 q_j$$
    where $s_j$ is each of the possible $n^2$ outcomes and $q_j=\left(\frac 12\right)^2$ are the corresponding probabilities.
  2. Use the calculation rules that apply to expectations:
    $$E(S^2) = E\Big((X_1 + .. + X_n)^2\Big) = E\Big(X_1^2 + .. X_n^2 + \sum_{i\ne j} 2X_iX_j\Big) = E(X_1^2) + ... + E(X_n^2) + 2 \sum_{i\ne j} E(X_iX_j)$$
    What is $E(X_iX_j)$ with $i\ne j$?
  3. Use that generally $\sigma^2(Y) = E\Big((Y-EY)^2\Big) = E(Y^2) - (EY)^2$ and substitute $Y=S=X_1+...+X_n$.
(Thinking)
 
  • #11
Klaas van Aarsen said:
I see the following possible approaches:

  1. Apply the definition of expectation directly.
    $$E(S^2) = \sum_j s_j^2 q_j$$
    where $s_j$ is each of the possible $n^2$ outcomes and $q_j=\left(\frac 12\right)^2$ are the corresponding probabilities.
  2. Use the calculation rules that apply to expectations:
    $$E(S^2) = E\Big((X_1 + .. + X_n)^2\Big) = E\Big(X_1^2 + .. X_n^2 + \sum_{i\ne j} 2X_iX_j\Big) = E(X_1^2) + ... + E(X_n^2) + 2 \sum_{i\ne j} E(X_iX_j)$$
    What is $E(X_iX_j)$ with $i\ne j$?
  3. Use that generally $\sigma^2(Y) = E\Big((Y-EY)^2\Big) = E(Y^2) - (EY)^2$ and substitute $Y=S=X_1+...+X_n$.
(Thinking)

Hello,
What is $E(X_iX_j)$ with $i\ne j$? would you explain?
 
  • #12
Dhamnekar Winod said:
Hello,
What is $E(X_iX_j)$ with $i\ne j$? would you explain?

An expectation is the sum of the possible outcomes times their probability.
In this case the possible outcomes are $\pm2 \cdot \pm 2$ and since they are independent each has probability $\frac 12 \cdot \frac 12 = \frac 14$.
So:
$$E(X_iX_j) = (-2\cdot -2)\cdot \frac 14 + (-2 \cdot 2)\cdot \frac 14 + (2 \cdot -2) \cdot \frac 14+ (2\cdot 2)\cdot \frac 14 = 0$$
 

Similar threads

  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 8 ·
Replies
8
Views
1K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 9 ·
Replies
9
Views
2K
  • · Replies 3 ·
Replies
3
Views
3K
  • · Replies 8 ·
Replies
8
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 5 ·
Replies
5
Views
2K