Expectation of a sum of random variables

Click For Summary
SUMMARY

The discussion centers on the expectation of the sum of random variables, specifically the expression E[(A+B)^2]. Participants clarify that E[(A+B)^2] can be expanded to E[A^2] + 2E[AB] + E[B^2], and that simplifications depend on the independence of A and B. It is established that if A and B are independent, E[AB] equals E[A]E[B]. The example of A and B being normally distributed with mean 0 and variance 1 is used to illustrate the calculations of E[A^2] and E[AB].

PREREQUISITES
  • Understanding of random variables and their expectations
  • Familiarity with the properties of variance and covariance
  • Knowledge of probability distributions, particularly the normal distribution
  • Basic proficiency in LaTeX for mathematical notation
NEXT STEPS
  • Study the properties of variance and covariance in detail
  • Learn about the implications of independence in probability theory
  • Explore the Chi-squared distribution and its applications
  • Practice using LaTeX for mathematical expressions and proofs
USEFUL FOR

Students and professionals in statistics, data science, and mathematics who are looking to deepen their understanding of expectations and variances of random variables.

docnet
Messages
796
Reaction score
486
Homework Statement
Given ##E[A]=0## and ##E[B]=b##, can ##E[(A+B)^2]## be simplified?
Relevant Equations
##E[A]## is the expectation of ##A##.
$$\begin{align*}
E[(A+B)^2]&=E[A^2+2AB+B^2]\\
&=E[A^2]+2E[AB]+E[B^2]\\
&=2E[AB]+E[B^2].
\end{align*}$$

Can the terms ##2E[AB]## and ##E[B^2]## be simplified any more? Thanks, friends.
 
Physics news on Phys.org
How did you estimate E[A^2]?
E[ AB ]=E[ A ]E[ B ]
 
anuttarasammyak said:
E[AB]=E[A]E How did you estimate ##E[A^2]##?
Oh I have made a mistake.. we do not know that ##E[A^2]=0##.

If ##A## takes values ##-1## and ##1## with equal probability then ##A^2=1## with probability ##1##. So ##E[A^2]=1.##.

Thank you!
 
  • Like
Likes   Reactions: Gavran and anuttarasammyak
anuttarasammyak said:
How did you estimate E[A^2]?
E[ AB ]=E[ A ]E[ B ]

This is only valid if A and B are independent (it doesn't hold, for example, when A = B), and we are not told that they are.

Using \newcommand{\Var}{\operatorname{Var}}\Var(X) = \mathbb{E}[X^2] - (\mathbb{E}[X])^2, we have <br /> \mathbb{E}[(A + B)^2] = \Var(A + B) + (\mathbb{E}[A + B])^2 = \Var(A + B) + b^2.
 
  • Like
Likes   Reactions: docnet, anuttarasammyak and WWGD
pasmith said:
This is only valid if A and B are independent (it doesn't hold, for example, when A = B), and we are not told that they are.

Using \newcommand{\Var}{\operatorname{Var}}\Var(X) = \mathbb{E}[X^2] - (\mathbb{E}[X])^2, we have <br /> \mathbb{E}[(A + B)^2] = \Var(A + B) + (\mathbb{E}[A + B])^2 = \Var(A + B) + b^2.
That is extremely useful ! Thanks.
 
pasmith said:
This is only valid if A and B are independent (it doesn't hold, for example, when A = B), and we are not told that they are.

Using \newcommand{\Var}{\operatorname{Var}}\Var(X) = \mathbb{E}[X^2] - (\mathbb{E}[X])^2, we have <br /> \mathbb{E}[(A + B)^2] = \Var(A + B) + (\mathbb{E}[A + B])^2 = \Var(A + B) + b^2.
I can think further of your example when ##A=B \sim~N(0,1)##, so that ##A^2 \~ sim mathbb Chi^2(1)##, with expectation/expected value ##1##, while ##E[A]=0##, so that ##E[A^2]=1 \neq E[A]E[A]=0.0=0##
 
Last edited:
  • Like
Likes   Reactions: docnet
pasmith said:
This is only valid if A and B are independent (it doesn't hold, for example, when A = B), and we are not told that they are.

Using \newcommand{\Var}{\operatorname{Var}}\Var(X) = \mathbb{E}[X^2] - (\mathbb{E}[X])^2, we have <br /> \mathbb{E}[(A + B)^2] = \Var(A + B) + (\mathbb{E}[A + B])^2 = \Var(A + B) + b^2.
I can think further of your example when ##A=B \sim\mathbb N(0,1)##, so that ##A^2 \sim \mathbb{ \chi^2(1)}##, with expectation/expected value ##1##, while ##E[A]=0##, so that ##E[A^2]=1 \neq E[A]E[A]=0.0=0##
 
Last edited:
  • Like
Likes   Reactions: docnet
WWGD said:
I can think further of your example when ##A=B ## ~##\mathbb N(0,1)##, so that ##A^2 ## ~##\ mathbb \chi^2(1)##, with expectation/expected value ##1##, while ##E[A]=0##, so that ##E[A^2]=1 \neq E[A]E[A]=0.0=##
Try ##\sim##
 
  • Like
Likes   Reactions: WWGD and docnet
Orodruin said:
Try ##\sim##
Thanks, fixed it. Phew! Need an upgrade and refresher on my Tex.
 
Last edited:
  • Like
Likes   Reactions: docnet
  • #10
What is it meant by simplified? $$ E [ ( A + B ) ^ 2 ] $$ is simpler than $$ E [ A ^ 2 ] + 2 E [ A B ] + E [ B ^ 2 ] $$ and demands less calculation. Only in the case where A and B are independent $$ E [ ( A + B ) ^ 2 ] $$ can become a simpler expression which is $$ E [ A ^ 2 ] + E [ B ^ 2 ] $$ and which demands less calculation.
 
  • Like
Likes   Reactions: docnet
  • #11
Gavran said:
What is it meant by simplified? $$ E [ ( A + B ) ^ 2 ] $$ is simpler than $$ E [ A ^ 2 ] + 2 E [ A B ] + E [ B ^ 2 ] $$ and demands less calculation. Only in the case where A and B are independent $$ E [ ( A + B ) ^ 2 ] $$ can become a simpler expression which is $$ E [ A ^ 2 ] + E [ B ^ 2 ] $$ and which demands less calculation.

A and B being independent does not imply that E[AB] = 0.
 
  • Like
Likes   Reactions: docnet
  • #12
pasmith said:
A and B being independent does not imply that E[AB] = 0.
It does if you pair it with ##E[A]=0## as given in the OP.
 
  • Like
Likes   Reactions: docnet

Similar threads

Replies
9
Views
2K
  • · Replies 11 ·
Replies
11
Views
1K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 16 ·
Replies
16
Views
3K
  • · Replies 4 ·
Replies
4
Views
1K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K