Correlation coefficient: show 1-r^2 is the ratio of 0th and 1st order models

  • Thread starter applestrudle
  • Start date
  • #1
applestrudle
64
0
Homework Statement
You have a linear model y = a+bx. Using the mean square error function for a zeroth order model (b=0 and a = <y>) and a first order model b=Covariance(x,y)/Variance(x) and a = <y> - b<x> show that E1/E0 = 1-r^2
Relevant Equations
MSE function E = <(y - a -bx)^2>
Correlation coefficient r = Covariance(x,y)/Standardev(x)Standarddev(y)
Standarddev = Square root of variance
The zeroth order model gives E0 = Var(y)

I've tried two methods:
Calculating 1-r^2 and trying to get E1/E0.
Calculating E1/E0 and trying to get 1-r^2.
 
Physics news on Phys.org
  • #2
applestrudle said:
I've tried two methods:
And what do you get?
 
  • #3
@applestrudle I'm a bit confused by your notation overall. You defined E as a function of x ( equiv y) then used E0, E1. Is E0:=E(0), E1:=E(1)?
 
  • #4
You haven't written down what ##r^2## is, which feels like an important piece.
 

What is the correlation coefficient?

The correlation coefficient is a statistical measure that indicates the strength and direction of the linear relationship between two variables. It is denoted by the symbol "r" and ranges from -1 to 1, with 0 indicating no correlation and 1 or -1 indicating a perfect positive or negative correlation, respectively.

What does 1-r^2 represent?

1-r^2 represents the proportion of variance in one variable that can be explained by the other variable in a linear regression model. It is also known as the coefficient of determination and is often interpreted as the "goodness of fit" of the model.

Why is 1-r^2 used as the ratio of 0th and 1st order models?

In linear regression, the 0th order model is the simplest model with just a y-intercept and no independent variable. The 1st order model includes the independent variable and has a slope in addition to the y-intercept. The ratio of 0th and 1st order models, 1-r^2, is used to determine how much better the 1st order model is at explaining the variance in the data compared to the 0th order model.

How is the correlation coefficient calculated?

The correlation coefficient is calculated by dividing the covariance of the two variables by the product of their standard deviations. This can also be represented as the sum of the products of the standardized values of each variable divided by the number of data points.

What is the relationship between the correlation coefficient and the strength of the linear relationship?

The correlation coefficient is a measure of the strength of the linear relationship between two variables. A correlation coefficient closer to 1 or -1 indicates a stronger linear relationship, while a coefficient closer to 0 indicates a weaker relationship. However, it is important to note that a correlation coefficient of 0 does not necessarily mean there is no relationship between the variables, as there could still be a non-linear relationship present.

Similar threads

  • Calculus and Beyond Homework Help
Replies
7
Views
710
  • Calculus and Beyond Homework Help
Replies
2
Views
465
Replies
1
Views
631
  • Calculus and Beyond Homework Help
Replies
7
Views
2K
  • Calculus and Beyond Homework Help
Replies
2
Views
951
  • Calculus and Beyond Homework Help
Replies
1
Views
768
  • Calculus and Beyond Homework Help
Replies
4
Views
925
  • Advanced Physics Homework Help
Replies
7
Views
1K
  • Calculus and Beyond Homework Help
Replies
2
Views
1K
  • Calculus and Beyond Homework Help
Replies
5
Views
1K
Back
Top