Simplifying correlation coefficient

Join the discussion
Ask a follow-up here, or get your own question answered by working scientists, mathematicians and engineers — people, not an autocomplete.
Real named experts · corrections over time · the nuance an AI answer skips
2 replies · 1K views
Dustinsfl
Messages
2,217
Reaction score
5

Homework Statement


The linear prediction of one random variable based on the outcome of another becomes more difficult if noise is present. We model noise as the addition of an uncorrelated random variable. Specifically, assume that we wish to predict ##X## based on observing ##X + N##, where ##N## represents the noise. If ##X## and ##N## are both zero mean random variables that are uncorrelated with each other, determine the correlation coefficient between ##W = X## and ##Z = X + N##. How does it depend on the power in ##X##, which is defined as ##E_X[X^2]##, and the power in ##N##, also defined as ##E_N[N^2]##?

Homework Equations


The correlation coefficient is define as
$$
\rho_{W, Z} = \frac{cov(W, Z)}{\sqrt{var(W)var(Z)}}.
$$
Let's note some standard identities which may be useful.
\begin{align*}
cov(X + Y, X) &= cov(X, X) + cov(Y, X)\\
cov(X, X) &= var(X)\\
var(X + Y) &= var(X) + var(Y) + 2cov(X, Y)
\end{align*}
Since ##X## and ##N## are uncorrelated, ##cov(X, N) = 0##.

The Attempt at a Solution


I have reduced the coefficient down to
\begin{align*}
\rho_{W, Z} &= \frac{cov(W, Z)}{\sqrt{var(W)var(Z)}}\\
&= \frac{\sqrt{var(X)}}{\sqrt{var(X) + var(N)}}\\
&= \sqrt{\frac{E[X^2] - E^2[X]}
{E[X^2] - E^2[X] + E[N^2] - E^2[N]}}\\
&= \frac{1}{\sqrt{1 + \frac{E[N^2] - E^2[N]}
{E[X^2] - E^2[X]}}}
\end{align*}
but the answer can be reduced further to
$$
\sqrt{\frac{\eta}{\eta + 1}}
$$
where ##\eta = \frac{E[X^2]}{E[N^2]}##.

I don't see how I can get to this expression.
 
Physics news on Phys.org
haruspex said:
You are given E[X] and E[N].
From this part (emphasis added) - "If X and N are both zero mean random variables that are uncorrelated with each other.."