Distribution, expected value, variance, covariance and correlation

Click For Summary

Discussion Overview

The discussion revolves around the properties of independent random variables, specifically focusing on the distribution, expected value, variance, covariance, and correlation of products of these variables. The context includes theoretical calculations and mathematical reasoning related to Bernoulli and Poisson distributions.

Discussion Character

  • Mathematical reasoning
  • Technical explanation
  • Exploratory

Main Points Raised

  • Participants discuss the calculation of the distribution, expected value, and variance of the product of independent random variables, specifically $XY$ where $X$ is Bernoulli and $Y$ is Poisson.
  • There is a query about the correctness of the probability calculations for $P(XY=0)$ and the contributions from the cases when $X=0$ and $X=1$.
  • Some participants propose that the expected value can be calculated as $E[XY]=E[X]\cdot E[Y]$ due to independence.
  • Discussion on how to calculate $E((XY)^2)$ leads to the conclusion that it can be expressed as $E[X^2]\cdot E[Y^2]$ because $X^2$ and $Y^2$ are independent.
  • Participants explore the definitions of $E[X^2]$ and $E[Y^2]$, with references to variances of the respective distributions.
  • The covariance between $XY$ and $XZ$ is expressed as $\text{Cov}(XY, XZ)=E[(XY)(XZ)]-E[XY]E[XZ]$, with a discussion on how to compute $E[(XY)(XZ)]$.
  • The correlation between $XY$ and $XZ$ is derived using the covariance and variances of the products.

Areas of Agreement / Disagreement

Participants express uncertainty about specific calculations and definitions but generally agree on the methods for calculating expected values and variances. There is no explicit consensus on all points, as some calculations are questioned and refined throughout the discussion.

Contextual Notes

Some calculations depend on the correct application of properties of independent random variables, and there are unresolved aspects regarding the definitions of certain expected values and variances.

mathmari
Gold Member
MHB
Messages
4,984
Reaction score
7
Hey! :giggle:

Let $X$, $Y$ and $Z$ be independent random variables. Let $X$ be Bernoulli distributed on $\{0,1\}$ with success parameter $p_0$ and let $Y$ be Poisson distributed with parameter $\lambda$ and let $Z$ be Poisson distributed with parameter $\mu$.

(a) Calculate the distribution, the expected value and the variance of $XY$.

(b) Determine the Covariance and the correlation between $XY$ and $XZ$.
For question (a) :

We have that $$P(X=0)=1-p_0 \ \text{ and} \ P(X=1)=p_0$$ and $$P(Y=k)=\frac{\lambda^k}{k!}\cdot e^{-\lambda}$$

Sodo we get that $$P(XY=k)=P(XY=k|X=0)P(X=0)+P(XY=k|X=1)P(X=1)$$ If $k=0$ then \begin{align*}P(XY=0)&=P(XY=0|X=0)P(X=0)+P(XY=0|X=1)P(X=1)\\ & =1-p_0+e^{-\lambda}\end{align*} If $k\neq 0$ then \begin{align*}P(XY=k)&=P(XY=k|X=0)P(X=0)+P(XY=k|X=1)P(X=1)\\ & =0+\frac{\lambda^k}{k!}\cdot e^{-\lambda}\cdot p_0\\ & = \frac{\lambda^k}{k!}\cdot e^{-\lambda}\cdot p_0\end{align*}

Is that correct? :unsure:
 
Physics news on Phys.org
mathmari said:
If $k=0$ then \begin{align*}P(XY=0)&=P(XY=0|X=0)P(X=0)+P(XY=0|X=1)P(X=1)\\ & =1-p_0+e^{-\lambda}\end{align*}
Hey mathmari!

Don't we have $P(XY=0|X=1)P(X=1) \,=\, P(Y=0)P(X=1) \,=\, e^{-\lambda}\cdot p_0$? :unsure:
 
Klaas van Aarsen said:
Don't we have $P(XY=0|X=1)P(X=1) \,=\, P(Y=0)P(X=1) \,=\, e^{-\lambda}\cdot p_0$? :unsure:

Ahh yes! (Malthe)

Then the expected value is $E[XY]=E[X]\cdot E[Y]$ because they are independent, right?

About the variance we have $V(XY)=E((XY)^2)-(E[XY])^2$, but how do we calculate $E((XY)^2)$ ?

:unsure:
 
mathmari said:
About the variance we have $V(XY)=E((XY)^2)-(E[XY])^2$, but how do we calculate $E((XY)^2)$ ?
We have $E\big((XY)^2\big) = E\big(X^2\cdot Y^2\big)$ and since $X$ and $Y$ are independent, $X^2$ and $Y^2$ will also be independent. 🤔
 
Klaas van Aarsen said:
We have $E\big((XY)^2\big) = E\big(X^2\cdot Y^2\big)$ and since $X$ and $Y$ are independent, $X^2$ and $Y^2$ will also be independent. 🤔

Ahh ok! So it is $E[X^2]\cdot E[Y^2]$. But how are these factors defined? I got stuk right now.. Do we use the variance? :unsure:
 
mathmari said:
Ahh ok! So it is $E[X^2]\cdot E[Y^2]$. But how are these factors defined? I got stuk right now.
Easiest is to look up the variances of the Bernoulli and Poison distributions and use those. 🤔
 
Last edited:
Klaas van Aarsen said:
Easiest is to look up the variances of the Bernouli and Poison distributions and use those. 🤔

We have the following :
\begin{equation*}V(XY)=E((XY)^2)-(E[XY])^2= E\big(X^2\cdot Y^2\big)-\left (p\cdot \lambda\right )^2= E\big(X^2\big)\cdot E\big( Y^2\big)-p^2\cdot \lambda^2\end{equation*}
The variance of $X$ is $\text{Var}(X)=p(1-p)$ and \begin{align*}E(X^2)-(E(X))^2=p(1-p) &\Rightarrow E(X^2)=p(1-p)+(E(X))^2 \Rightarrow E(X^2)=p(1-p)+p^2 \\ & \Rightarrow E(X^2)=p-p^2+p^2\Rightarrow E(X^2)=p\end{align*}
The variance $Y$ is $\text{Var}(Y)=\lambda$ and \begin{equation*}E(Y^2)-(E(Y))^2=\lambda \Rightarrow E(Y^2)=\lambda+(E(Y))^2 \Rightarrow E(Y^2)=\lambda+\lambda^2 \end{equation*}
So we get \begin{equation*}V(XY)= E\big(X^2\big)\cdot E\big( Y^2\big)-p^2\cdot \lambda^2= p\cdot \left (\lambda+\lambda^2\right )-p^2\cdot \lambda^2= p\cdot \lambda+p\cdot\lambda^2-p^2\cdot \lambda^2= p\cdot \lambda+(p-p^2)\cdot \lambda^2\end{equation*}

:unsure:
 
Looks correct to me. :unsure:
 
Klaas van Aarsen said:
Looks correct to me. :unsure:

Great! For question (b) : The covariance is $\text{Cov}(XY, XZ)=E[(XY)(XZ)]-E[XY]E[XZ]$.

How do we calculate $E[(XY)(XZ)]$ ? :unsure:
 
  • #10
mathmari said:
How do we calculate $E[(XY)(XZ)]$ ?
Isn't it the same as $E[X^2\cdot Y \cdot Z]$? :unsure:
 
  • #11
Klaas van Aarsen said:
Isn't it the same as $E[X^2\cdot Y \cdot Z]$? :unsure:

Ah and this is equal to $E[X^2]\cdot E[Y] \cdot [Z]$ because these are independent random variables, right? :unsure:
 
  • #12
mathmari said:
Ah and this is equal to $E[X^2]\cdot E[Y] \cdot [Z]$ because these are independent random variables, right?
Yep. (Nod)
 
  • #13
Klaas van Aarsen said:
Yep. (Nod)

So we have the following:

The covariance of $XY$ and $XZ$ is \begin{align*}\text{Cov}(XY, XZ)&=E[(XY)(XZ)]-E[XY]E[XZ]=E[X^2\cdot Y \cdot Z]-p\cdot \lambda\cdot p\cdot \mu=E[X^2]\cdot E[Y] \cdot E[Z]-p\cdot \lambda\cdot p\cdot \mu\\ & =p\cdot \lambda \cdot \mu-p^2\cdot \lambda\cdot \mu=(p-p^2)\cdot \lambda \cdot \mu\end{align*}
The correlation of $XY$ and $XZ$ is \begin{align*}\rho _{XY,XZ}={\frac {\operatorname {Cov} (XY,XZ)}{{\sqrt {\operatorname {Var} (XY)}}{\sqrt {\operatorname {Var} (XZ)}}}}={\frac {(p-p^2)\cdot \lambda \cdot \mu}{{\sqrt {p\cdot \lambda+(p-p^2)\cdot \lambda^2}}{\sqrt {p\cdot \mu+(p-p^2)\cdot \mu^2}}}}\end{align*}

Is everything correct? :unsure:
 
  • #14
It looks correct to me. :unsure:
 
  • #15
Klaas van Aarsen said:
It looks correct to me. :unsure:

Great! Thank you! (Sun)
 

Similar threads

  • · Replies 10 ·
Replies
10
Views
1K
  • · Replies 3 ·
Replies
3
Views
1K
  • · Replies 2 ·
Replies
2
Views
4K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 5 ·
Replies
5
Views
2K
Replies
1
Views
4K
  • · Replies 9 ·
Replies
9
Views
3K