Simplifying correlation coefficient

Click For Summary
SUMMARY

The correlation coefficient between the random variable ##W = X## and the noisy observation ##Z = X + N## is derived using the formula $$\rho_{W, Z} = \frac{cov(W, Z)}{\sqrt{var(W)var(Z)}}$$. The final expression for the correlation coefficient simplifies to $$\sqrt{\frac{\eta}{\eta + 1}}$$, where ##\eta = \frac{E[X^2]}{E[N^2]}##. This indicates that the correlation depends on the ratio of the powers of the original variable and the noise, specifically the expected values of their squares.

PREREQUISITES
  • Understanding of correlation coefficients in statistics
  • Familiarity with covariance and variance concepts
  • Knowledge of random variables and their properties
  • Basic proficiency in mathematical notation and equations
NEXT STEPS
  • Study the derivation of covariance and its properties
  • Learn about the implications of noise in statistical modeling
  • Explore the concept of power in random variables
  • Investigate applications of correlation coefficients in predictive modeling
USEFUL FOR

Students in statistics, data analysts, and researchers focusing on predictive modeling and noise analysis in data. This discussion is particularly beneficial for those studying the effects of noise on correlation in statistical predictions.

Dustinsfl
Messages
2,217
Reaction score
5

Homework Statement


The linear prediction of one random variable based on the outcome of another becomes more difficult if noise is present. We model noise as the addition of an uncorrelated random variable. Specifically, assume that we wish to predict ##X## based on observing ##X + N##, where ##N## represents the noise. If ##X## and ##N## are both zero mean random variables that are uncorrelated with each other, determine the correlation coefficient between ##W = X## and ##Z = X + N##. How does it depend on the power in ##X##, which is defined as ##E_X[X^2]##, and the power in ##N##, also defined as ##E_N[N^2]##?

Homework Equations


The correlation coefficient is define as
$$
\rho_{W, Z} = \frac{cov(W, Z)}{\sqrt{var(W)var(Z)}}.
$$
Let's note some standard identities which may be useful.
\begin{align*}
cov(X + Y, X) &= cov(X, X) + cov(Y, X)\\
cov(X, X) &= var(X)\\
var(X + Y) &= var(X) + var(Y) + 2cov(X, Y)
\end{align*}
Since ##X## and ##N## are uncorrelated, ##cov(X, N) = 0##.

The Attempt at a Solution


I have reduced the coefficient down to
\begin{align*}
\rho_{W, Z} &= \frac{cov(W, Z)}{\sqrt{var(W)var(Z)}}\\
&= \frac{\sqrt{var(X)}}{\sqrt{var(X) + var(N)}}\\
&= \sqrt{\frac{E[X^2] - E^2[X]}
{E[X^2] - E^2[X] + E[N^2] - E^2[N]}}\\
&= \frac{1}{\sqrt{1 + \frac{E[N^2] - E^2[N]}
{E[X^2] - E^2[X]}}}
\end{align*}
but the answer can be reduced further to
$$
\sqrt{\frac{\eta}{\eta + 1}}
$$
where ##\eta = \frac{E[X^2]}{E[N^2]}##.

I don't see how I can get to this expression.
 
Physics news on Phys.org
You are given E[X] and E[N].
 
  • Like
Likes   Reactions: Dustinsfl
haruspex said:
You are given E[X] and E[N].
From this part (emphasis added) - "If X and N are both zero mean random variables that are uncorrelated with each other.."
 

Similar threads

  • · Replies 2 ·
Replies
2
Views
6K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 8 ·
Replies
8
Views
3K
Replies
3
Views
2K
Replies
6
Views
2K
  • · Replies 10 ·
Replies
10
Views
3K
  • · Replies 8 ·
Replies
8
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K