Least squares assumptions: finite and nonzero 4th moments

Click For Summary

Homework Help Overview

The discussion revolves around the assumptions of least squares estimation, specifically focusing on the significance of having nonzero finite fourth moments in relation to the presence of large outliers in the data. The original poster seeks clarification on the relationship between these statistical concepts and their implications for ordinary least squares (OLS) estimation.

Discussion Character

  • Conceptual clarification, Assumption checking

Approaches and Questions Raised

  • Participants explore the intuitive understanding of why finite fourth moments are significant for least squares assumptions and how they relate to the likelihood of outliers. There is a focus on the implications of these assumptions for the robustness of least squares methods.

Discussion Status

Some participants have provided insights into the relationship between finite fourth moments and the probability of large outliers, suggesting that this assumption helps ensure consistent estimation of variances. The discussion appears to be productive, with references to external resources for further reading.

Contextual Notes

The original poster notes that the inquiry is not for a homework assignment but rather for personal understanding, indicating a desire for intuitive explanations rather than formal solutions.

slakedlime
Messages
74
Reaction score
2
This isn't a homework problem - I'm just confused by something in a textbook that I'm reading (not for a class, either). I'd appreciate an intuitive clarification, or a link to a good explanation (can't seem to find anything useful on Google or in my textbook).

My book states that one of the least squares assumptions (e.g. for ordinary least squares, OLS, estimation) is that large outliers are unlikely.

That is, for the following equation:
Y_{i} = β_{0}+β_{1}X_i+u_{i}

It must be that (X_{i}, Y_{i}), i = 1, ..., n have nonzero finite fourth moments.

Why is this significant? What is the relationship between large outliers and nonzero finite fourth moments? I don't intuitively see the mathematical explanation. Any help and/or direction is much appreciated.
 
Physics news on Phys.org
The real importance of the fourth moment statement is that with it in place the underlying ideas needed for consistent estimation of variances are easily verified.
The argument that links the finite fourth moments to outliers can be intuitively stated as: if the fourth moments are finite, then the tails of the distribution are relatively short, so the PROBABILITY of unusually large observations occurring is small. In that regard it's an assumption made to try to account for the fact that least squares regression (least squares methods in general) are non-robust and results are very sensitive to the presence of outliers.
The better notion is: if you believe outliers could be an issue, use a method for robust regression.

The notion you ask about is discussed in this article.
http://www.aw-bc.com/info/stock_watson/Chapter4.pdf
 
Thank you so much!
 
thank you
 
statdad said:
The real importance of the fourth moment statement is that with it in place the underlying ideas needed for consistent estimation of variances are easily verified.
The argument that links the finite fourth moments to outliers can be intuitively stated as: if the fourth moments are finite, then the tails of the distribution are relatively short, so the PROBABILITY of unusually large observations occurring is small. In that regard it's an assumption made to try to account for the fact that least squares regression (least squares methods in general) are non-robust and results are very sensitive to the presence of outliers.
The better notion is: if you believe outliers could be an issue, use a method for robust regression.

The notion you ask about is discussed in this article.
http://www.aw-bc.com/info/stock_watson/Chapter4.pdf

Access is forbidden!
 

Similar threads

  • · Replies 7 ·
Replies
7
Views
3K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 8 ·
Replies
8
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 2 ·
Replies
2
Views
3K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 6 ·
Replies
6
Views
4K
Replies
3
Views
5K