Error in (Multi)linear Regression

Join the discussion
Ask a follow-up here, or get your own question answered by working scientists, mathematicians and engineers — people, not an autocomplete.
Real named experts · corrections over time · the nuance an AI answer skips
3 replies · 2K views
Messages
7,822
Reaction score
13,151
Hi,
I keep reading varying accounts on conditions needed to " justify" the use of ( multi) linear regression to model data.

Specifically, I have seen several authors require errors to be normal, i.i.d , whilr others only require the errors be i.i.d with mean 0. Just where is the assumption of normality used to justify the use of linear models? I know of Gauss Mark of, but this seems too strong. I've heard that it is used to find the distribution of the coefficients and determine reliable confidence intervals for the coefficients? If so, do you suggest a source? If not, can you explain?
 
Physics news on Phys.org
I guess the question is what does "justify" mean. If the errors are zero mean iid normal and equally distributed, then I think the multi linear model is an unbiased estimator of the actual values. If the errors are otherwise distributed then a different model (i.e. different coefficients) might be a better choice.

But in practice, a multi linear model works pretty well in lots of other situations, and it's often hard to know that the errors actually look like.
 
Reply
  • Like
Likes   Reactions: WWGD
You just mean give a scenario where a non linear model is better? Sure, suppose you drop an object, and write down the time and the height at those times as it falls. The height measurement has some noise to it. Then the right model for the height is going to be something like ##h(t)=-\frac{g}{2}t^2+h_0## if it starts at a height of ##h_0##.

I feel like there's a good chance I did not understand the question.