Prove Linear Correlation: m/sqrt(m^2) = sgn(m)

  • Context: Graduate 
  • Thread starter Thread starter rwinston
  • Start date Start date
  • Tags Tags
    Correlation Linear
Click For Summary
SUMMARY

The discussion centers on proving the linear correlation between two random variables X and Y, defined by the equation Y = mX + b. The proof demonstrates that the correlation coefficient corr(X,Y) equals m/sqrt(m^2), which simplifies to sgn(m), the sign function of m. The participants clarify that the correct derivation involves recognizing that the b terms cancel out, leading to the conclusion that E(XY) - E(X)E(Y) equals m(Var(X)), with the denominator being |m|Var(X).

PREREQUISITES
  • Understanding of correlation coefficients in statistics
  • Familiarity with the properties of expected values (E) and variance (Var)
  • Knowledge of linear equations and their components (slope m and intercept b)
  • Basic concepts of statistical physics and random variables
NEXT STEPS
  • Study the derivation of correlation coefficients in detail
  • Learn about the properties of variance and how they apply to linear transformations
  • Explore the implications of the sign function (sgn) in statistical analysis
  • Investigate the role of deterministic parameters in statistical models
USEFUL FOR

Students and professionals in statistics, data analysis, and statistical physics, particularly those interested in understanding linear relationships between random variables.

rwinston
Messages
36
Reaction score
0
I am going through some of the problems in a statistical physics book. I am stuck on the following question:

If we have two random variables X and Y, related by Y=mX + b => y(i) = mx(i) + b, where b and m are deterministic, prove that corr(X,Y) = m/sqrt(m^2) = sgn(m), where sgn(m) is the sign function of m.

I can see that this is perfect linear correlation, but I am not sure as to what is the obvious proof...I know that corr(X,Y) = (E(XY) - E(X)E(Y))/sd(X)*sd(Y)...

Is the following derivation even logically valid?
E(XY)-E(X)E(Y)
= E(X(mX+b)) - E(X)E(mX+b)
=E(mX^2 + bX)-E(X)E(mX+b)
=mE(X^2)+bE(X)-mE(X)E(X)+b
=m(E(X^2)-E(X)E(X))+bE(X)+b
=m(Var(X))+bE(X) +b

Thanks!
 
Physics news on Phys.org
Your approach is valid. Your arithmetic is wrong.

E(XY)-E(X)E(Y)=m(Var(X)). The b terms cancel when you do it right!

The denominator will be |m|Var(X).
 
Thank you!
 

Similar threads

  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 7 ·
Replies
7
Views
2K
Replies
4
Views
1K
  • · Replies 43 ·
2
Replies
43
Views
6K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 58 ·
2
Replies
58
Views
7K
  • · Replies 8 ·
Replies
8
Views
3K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K