Expectation of a sum of random variables

Click For Summary

Homework Help Overview

The discussion revolves around the expectation of the sum of random variables, specifically focusing on the expression \(E[(A+B)^2]\) and its components. Participants explore the implications of independence between the variables \(A\) and \(B\) and how it affects the simplification of the expectation terms.

Discussion Character

  • Conceptual clarification, Assumption checking, Mathematical reasoning

Approaches and Questions Raised

  • Participants question the simplification of terms \(2E[AB]\) and \(E[B^2]\), with some attempting to clarify how \(E[A^2]\) is estimated. There is a discussion about the validity of \(E[AB] = E[A]E[B]\) under the assumption of independence.

Discussion Status

The discussion is active, with participants providing insights and questioning assumptions about independence and the properties of expectations. Some have offered useful perspectives on variance and the implications of specific distributions for \(A\) and \(B\).

Contextual Notes

There is an ongoing examination of the conditions under which certain properties hold, particularly regarding the independence of \(A\) and \(B\) and the implications for their expected values. Participants note that the original poster's assumptions may not be fully justified.

docnet
Messages
796
Reaction score
486
Homework Statement
Given ##E[A]=0## and ##E[B]=b##, can ##E[(A+B)^2]## be simplified?
Relevant Equations
##E[A]## is the expectation of ##A##.
$$\begin{align*}
E[(A+B)^2]&=E[A^2+2AB+B^2]\\
&=E[A^2]+2E[AB]+E[B^2]\\
&=2E[AB]+E[B^2].
\end{align*}$$

Can the terms ##2E[AB]## and ##E[B^2]## be simplified any more? Thanks, friends.
 
Physics news on Phys.org
How did you estimate E[A^2]?
E[ AB ]=E[ A ]E[ B ]
 
anuttarasammyak said:
E[AB]=E[A]E How did you estimate ##E[A^2]##?
Oh I have made a mistake.. we do not know that ##E[A^2]=0##.

If ##A## takes values ##-1## and ##1## with equal probability then ##A^2=1## with probability ##1##. So ##E[A^2]=1.##.

Thank you!
 
  • Like
Likes   Reactions: Gavran and anuttarasammyak
anuttarasammyak said:
How did you estimate E[A^2]?
E[ AB ]=E[ A ]E[ B ]

This is only valid if A and B are independent (it doesn't hold, for example, when A = B), and we are not told that they are.

Using \newcommand{\Var}{\operatorname{Var}}\Var(X) = \mathbb{E}[X^2] - (\mathbb{E}[X])^2, we have <br /> \mathbb{E}[(A + B)^2] = \Var(A + B) + (\mathbb{E}[A + B])^2 = \Var(A + B) + b^2.
 
  • Like
Likes   Reactions: docnet, anuttarasammyak and WWGD
pasmith said:
This is only valid if A and B are independent (it doesn't hold, for example, when A = B), and we are not told that they are.

Using \newcommand{\Var}{\operatorname{Var}}\Var(X) = \mathbb{E}[X^2] - (\mathbb{E}[X])^2, we have <br /> \mathbb{E}[(A + B)^2] = \Var(A + B) + (\mathbb{E}[A + B])^2 = \Var(A + B) + b^2.
That is extremely useful ! Thanks.
 
pasmith said:
This is only valid if A and B are independent (it doesn't hold, for example, when A = B), and we are not told that they are.

Using \newcommand{\Var}{\operatorname{Var}}\Var(X) = \mathbb{E}[X^2] - (\mathbb{E}[X])^2, we have <br /> \mathbb{E}[(A + B)^2] = \Var(A + B) + (\mathbb{E}[A + B])^2 = \Var(A + B) + b^2.
I can think further of your example when ##A=B \sim~N(0,1)##, so that ##A^2 \~ sim mathbb Chi^2(1)##, with expectation/expected value ##1##, while ##E[A]=0##, so that ##E[A^2]=1 \neq E[A]E[A]=0.0=0##
 
Last edited:
  • Like
Likes   Reactions: docnet
pasmith said:
This is only valid if A and B are independent (it doesn't hold, for example, when A = B), and we are not told that they are.

Using \newcommand{\Var}{\operatorname{Var}}\Var(X) = \mathbb{E}[X^2] - (\mathbb{E}[X])^2, we have <br /> \mathbb{E}[(A + B)^2] = \Var(A + B) + (\mathbb{E}[A + B])^2 = \Var(A + B) + b^2.
I can think further of your example when ##A=B \sim\mathbb N(0,1)##, so that ##A^2 \sim \mathbb{ \chi^2(1)}##, with expectation/expected value ##1##, while ##E[A]=0##, so that ##E[A^2]=1 \neq E[A]E[A]=0.0=0##
 
Last edited:
  • Like
Likes   Reactions: docnet
WWGD said:
I can think further of your example when ##A=B ## ~##\mathbb N(0,1)##, so that ##A^2 ## ~##\ mathbb \chi^2(1)##, with expectation/expected value ##1##, while ##E[A]=0##, so that ##E[A^2]=1 \neq E[A]E[A]=0.0=##
Try ##\sim##
 
  • Like
Likes   Reactions: WWGD and docnet
Orodruin said:
Try ##\sim##
Thanks, fixed it. Phew! Need an upgrade and refresher on my Tex.
 
Last edited:
  • Like
Likes   Reactions: docnet
  • #10
What is it meant by simplified? $$ E [ ( A + B ) ^ 2 ] $$ is simpler than $$ E [ A ^ 2 ] + 2 E [ A B ] + E [ B ^ 2 ] $$ and demands less calculation. Only in the case where A and B are independent $$ E [ ( A + B ) ^ 2 ] $$ can become a simpler expression which is $$ E [ A ^ 2 ] + E [ B ^ 2 ] $$ and which demands less calculation.
 
  • Like
Likes   Reactions: docnet
  • #11
Gavran said:
What is it meant by simplified? $$ E [ ( A + B ) ^ 2 ] $$ is simpler than $$ E [ A ^ 2 ] + 2 E [ A B ] + E [ B ^ 2 ] $$ and demands less calculation. Only in the case where A and B are independent $$ E [ ( A + B ) ^ 2 ] $$ can become a simpler expression which is $$ E [ A ^ 2 ] + E [ B ^ 2 ] $$ and which demands less calculation.

A and B being independent does not imply that E[AB] = 0.
 
  • Like
Likes   Reactions: docnet
  • #12
pasmith said:
A and B being independent does not imply that E[AB] = 0.
It does if you pair it with ##E[A]=0## as given in the OP.
 
  • Like
Likes   Reactions: docnet

Similar threads

Replies
9
Views
2K
  • · Replies 11 ·
Replies
11
Views
1K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 16 ·
Replies
16
Views
3K
  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 4 ·
Replies
4
Views
1K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K