How to calculate $E(X_iX_j)$ with $i\ne j$?

  • Context: MHB 
  • Thread starter Thread starter mathmari
  • Start date Start date
  • Tags Tags
    Expected value Value
Click For Summary

Discussion Overview

The discussion revolves around calculating the expectation of the product of two independent random variables, specifically $E(X_iX_j)$ for $i \ne j$, within the context of independent random variables $X_1, X_2, \ldots, X_{10}$ that take values $\pm 2$ with equal probability. Participants explore various approaches to compute $E(S^2)$, where $S$ is the sum of these random variables.

Discussion Character

  • Exploratory, Technical explanation, Mathematical reasoning, Debate/contested

Main Points Raised

  • One participant asks for hints on calculating $\mathbb{E}(S^2)$, expressing uncertainty about the process.
  • Another participant inquires about the expectations of individual variables, suggesting calculations for $\mathbb{E}(X_i)$, $\mathbb{E}(X_i + X_j)$, and $\mathbb{E}(X_i^2)$.
  • Some participants propose that $\mathbb{E}(X_i) = 0$ based on the symmetry of the values $\pm 2$.
  • There is a discussion about the relationship between $E(S^2)$ and the sum of the squares of the individual variables, with some participants questioning whether $S^2$ equals $\sum X_i^2$.
  • One participant outlines multiple approaches to calculate $E(S^2)$, including applying the definition of expectation and using properties of variance.
  • A later reply provides a detailed calculation for $E(X_iX_j)$, concluding that it equals $0$ based on the independence and distribution of the variables.

Areas of Agreement / Disagreement

Participants generally agree on the calculation of $\mathbb{E}(X_i)$ and its value being $0$. However, there is some contention regarding the relationship between $E(S^2)$ and $\sum X_i^2$, with no consensus reached on the implications of this relationship.

Contextual Notes

Participants express uncertainty about the correct application of expectation properties and the implications of independence in the calculations. The discussion includes various assumptions about the distributions and independence of the random variables.

Who May Find This Useful

This discussion may be useful for students or practitioners interested in probability theory, particularly in understanding expectations of sums and products of random variables, as well as the implications of independence in such calculations.

mathmari
Gold Member
MHB
Messages
4,984
Reaction score
7
Hey! :o

The random variables $X_1, X_2, \ldots , X_{10}$ are independent and have the same distribution function and each of them gets exactly the values $\pm 2$ and with equal probability.

We define the random variable $S=X_1+X_2+\ldots +X_{10}$.

I want to calculate $\mathbb{E}(S^2)$.

Could you give me a hint how we could calculate that? I don't really have an idea. (Wondering)
 
Physics news on Phys.org
Hey mathmari! (Smile)

What is the expectation of $X_1$?
Of $X_1+X_2$?
Of $X_1^2$? (Wondering)
 
I like Serena said:
What is the expectation of $X_1$?
Of $X_1+X_2$?
Of $X_1^2$? (Wondering)

Do we have the following?

$\mathbb{E}(X_i)=x_i\cdot p=(\pm 2)\cdot \frac{1}{10}=\pm\frac{1}{5}$
$\mathbb{E}(X_i+X_j)=\mathbb{E}(X_i)+\mathbb{E}(X_j)$
$\mathbb{E}(X_i^2)=x_i^2\cdot p=(\pm 2)^2\cdot \frac{1}{10}=4\cdot \frac{1}{10}=\frac{2}{5}$

(Wondering)
 
Don't we have:
$$EY=\sum_j y_jp_j$$
(Wondering)
 
I like Serena said:
Don't we have:
$$EY=\sum_j y_jp_j$$
(Wondering)
So do we have $E(X_i)=-2\cdot \frac{1}{2}+2\cdot \frac{1}{2}=0$ ? Or do you mean something else?
 
mathmari said:
So do we have $E(X_i)=-2\cdot \frac{1}{2}+2\cdot \frac{1}{2}=0$ ? Or do you mean something else?

Yes, that's what I meant.
 
I like Serena said:
Yes, that's what I meant.
Great! Do we get then $$E(S^2)=\sum E(X_i^2)=\sum x_i^2\cdot p=\sum 4\cdot \frac{1}{2}=10\cdot 2=20$$?
 
mathmari said:
Great! Do we get then $$E(S^2)=\sum E(X_i^2)=\sum x_i^2\cdot p=\sum 4\cdot \frac{1}{2}=10\cdot 2=20$$?

Isn't $S^2\ne \sum X_i^2$? (Worried)
 
I like Serena said:
Isn't $S^2\ne \sum X_i^2$? (Worried)

Ah ok.. but what can we do in this case?
 
  • #10
mathmari said:
Ah ok.. but what can we do in this case?

I see the following possible approaches:

  1. Apply the definition of expectation directly.
    $$E(S^2) = \sum_j s_j^2 q_j$$
    where $s_j$ is each of the possible $n^2$ outcomes and $q_j=\left(\frac 12\right)^2$ are the corresponding probabilities.
  2. Use the calculation rules that apply to expectations:
    $$E(S^2) = E\Big((X_1 + .. + X_n)^2\Big) = E\Big(X_1^2 + .. X_n^2 + \sum_{i\ne j} 2X_iX_j\Big) = E(X_1^2) + ... + E(X_n^2) + 2 \sum_{i\ne j} E(X_iX_j)$$
    What is $E(X_iX_j)$ with $i\ne j$?
  3. Use that generally $\sigma^2(Y) = E\Big((Y-EY)^2\Big) = E(Y^2) - (EY)^2$ and substitute $Y=S=X_1+...+X_n$.
(Thinking)
 
  • #11
Klaas van Aarsen said:
I see the following possible approaches:

  1. Apply the definition of expectation directly.
    $$E(S^2) = \sum_j s_j^2 q_j$$
    where $s_j$ is each of the possible $n^2$ outcomes and $q_j=\left(\frac 12\right)^2$ are the corresponding probabilities.
  2. Use the calculation rules that apply to expectations:
    $$E(S^2) = E\Big((X_1 + .. + X_n)^2\Big) = E\Big(X_1^2 + .. X_n^2 + \sum_{i\ne j} 2X_iX_j\Big) = E(X_1^2) + ... + E(X_n^2) + 2 \sum_{i\ne j} E(X_iX_j)$$
    What is $E(X_iX_j)$ with $i\ne j$?
  3. Use that generally $\sigma^2(Y) = E\Big((Y-EY)^2\Big) = E(Y^2) - (EY)^2$ and substitute $Y=S=X_1+...+X_n$.
(Thinking)

Hello,
What is $E(X_iX_j)$ with $i\ne j$? would you explain?
 
  • #12
Dhamnekar Winod said:
Hello,
What is $E(X_iX_j)$ with $i\ne j$? would you explain?

An expectation is the sum of the possible outcomes times their probability.
In this case the possible outcomes are $\pm2 \cdot \pm 2$ and since they are independent each has probability $\frac 12 \cdot \frac 12 = \frac 14$.
So:
$$E(X_iX_j) = (-2\cdot -2)\cdot \frac 14 + (-2 \cdot 2)\cdot \frac 14 + (2 \cdot -2) \cdot \frac 14+ (2\cdot 2)\cdot \frac 14 = 0$$
 

Similar threads

  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 3 ·
Replies
3
Views
3K
  • · Replies 8 ·
Replies
8
Views
1K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 9 ·
Replies
9
Views
2K
  • · Replies 8 ·
Replies
8
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 5 ·
Replies
5
Views
3K
  • · Replies 12 ·
Replies
12
Views
4K