Simplifying correlation coefficient

In summary: If X and N are both zero mean random variables that are uncorrelated with each other, then ##cov(X, N) = 0##.
  • #1
Dustinsfl
2,281
5

Homework Statement


The linear prediction of one random variable based on the outcome of another becomes more difficult if noise is present. We model noise as the addition of an uncorrelated random variable. Specifically, assume that we wish to predict ##X## based on observing ##X + N##, where ##N## represents the noise. If ##X## and ##N## are both zero mean random variables that are uncorrelated with each other, determine the correlation coefficient between ##W = X## and ##Z = X + N##. How does it depend on the power in ##X##, which is defined as ##E_X[X^2]##, and the power in ##N##, also defined as ##E_N[N^2]##?

Homework Equations


The correlation coefficient is define as
$$
\rho_{W, Z} = \frac{cov(W, Z)}{\sqrt{var(W)var(Z)}}.
$$
Let's note some standard identities which may be useful.
\begin{align*}
cov(X + Y, X) &= cov(X, X) + cov(Y, X)\\
cov(X, X) &= var(X)\\
var(X + Y) &= var(X) + var(Y) + 2cov(X, Y)
\end{align*}
Since ##X## and ##N## are uncorrelated, ##cov(X, N) = 0##.

The Attempt at a Solution


I have reduced the coefficient down to
\begin{align*}
\rho_{W, Z} &= \frac{cov(W, Z)}{\sqrt{var(W)var(Z)}}\\
&= \frac{\sqrt{var(X)}}{\sqrt{var(X) + var(N)}}\\
&= \sqrt{\frac{E[X^2] - E^2[X]}
{E[X^2] - E^2[X] + E[N^2] - E^2[N]}}\\
&= \frac{1}{\sqrt{1 + \frac{E[N^2] - E^2[N]}
{E[X^2] - E^2[X]}}}
\end{align*}
but the answer can be reduced further to
$$
\sqrt{\frac{\eta}{\eta + 1}}
$$
where ##\eta = \frac{E[X^2]}{E[N^2]}##.

I don't see how I can get to this expression.
 
Physics news on Phys.org
  • #2
You are given E[X] and E[N].
 
  • Like
Likes Dustinsfl
  • #3
haruspex said:
You are given E[X] and E[N].
From this part (emphasis added) - "If X and N are both zero mean random variables that are uncorrelated with each other.."
 

1. What does a correlation coefficient measure?

A correlation coefficient measures the strength and direction of the linear relationship between two variables. It tells us how closely the data points are clustered around a line on a scatter plot.

2. How is a correlation coefficient calculated?

A correlation coefficient is calculated by dividing the covariance of the two variables by the product of their standard deviations. This value ranges from -1 to 1, with a higher absolute value indicating a stronger correlation.

3. What is the difference between a positive and negative correlation coefficient?

A positive correlation coefficient indicates a direct relationship between the two variables, meaning that as one variable increases, the other also tends to increase. A negative correlation coefficient indicates an inverse relationship, meaning that as one variable increases, the other tends to decrease.

4. How can a correlation coefficient be interpreted?

A correlation coefficient can be interpreted as a measure of the degree of linear dependence between two variables. A value close to 0 indicates a weak or no relationship, while values closer to -1 or 1 indicate a strong relationship. However, correlation does not necessarily imply causation.

5. Can a correlation coefficient be used to determine causation?

No, a correlation coefficient only measures the strength and direction of a linear relationship between two variables. It does not indicate causation, as there may be other factors at play that are influencing the relationship between the variables.

Similar threads

  • Calculus and Beyond Homework Help
Replies
8
Views
1K
  • Calculus and Beyond Homework Help
Replies
1
Views
2K
  • Calculus and Beyond Homework Help
Replies
6
Views
757
  • Calculus and Beyond Homework Help
Replies
2
Views
6K
  • Calculus and Beyond Homework Help
Replies
8
Views
874
  • Calculus and Beyond Homework Help
Replies
11
Views
356
  • Calculus and Beyond Homework Help
Replies
1
Views
534
  • Calculus and Beyond Homework Help
Replies
3
Views
413
  • Calculus and Beyond Homework Help
Replies
9
Views
2K
  • Calculus and Beyond Homework Help
Replies
1
Views
703
Back
Top