A hideous Linear Regression/confidence set question

  • Thread starter Thread starter Phillips101
  • Start date Start date
  • Tags Tags
    Linear Set
AI Thread Summary
The discussion revolves around deriving the distribution of a specific quadratic form involving the maximum likelihood estimate (MLE) of beta in a linear regression model. The user believes that the expression (beta.hat - beta)' * X' * X * (beta.hat - beta) follows a sigma^2 chi-squared (n-p) distribution. They seek guidance on constructing a (1-a)-level confidence set for beta using an F distribution, acknowledging the need for another chi-squared component due to the unknown variance. The conversation highlights the challenge of estimating variance and the relevance of the MLE sigma2.hat as a chi-squared n-1 variable. Ultimately, the user is looking for clarification on how to proceed with these statistical concepts and their implications for confidence sets.
Phillips101
Messages
33
Reaction score
0
Take the linear model Y=X*beta+e, where e~Nn(0, sigma^2 * I), and it has MLE beta.hat

First, find the distribution of (beta.hat-beta)' * X'*X * (beta.hat-beta), where t' is t transpose. I think I've done this. I think it's a sigma^2 chi-squared (n-p) distribution.

Next, Hence find a (1-a)-level confidence set for beta based on a root with an F distribution. I can't do this to save my life. I'm aware that an F distribution is the ratio of two chi-squareds, but where the hell I'm going to get another chi squared from I have no idea. Also, we're dealing in -vectors- and I don't know how,what,why any confidence set is going to be or even look like, and I've no idea how to even try to get one.

-Any- help would be appreciated. Thanks
 
Physics news on Phys.org
Notice that

<br /> \frac{\hat{\beta}&#039; X&#039;X \hat{\beta}}{\sigma^2}<br />

has a \Chi^2 distribution. however, the variance is unknown, so you need to estimate it (with another expression from the regression). What would you use for the estimate, and what is its distribution?
 
Use the MLE sigma2.hat=(1/n)*||Y-Xbeta.hat||^2 ? This is distributed as a chi-squared n-1 variable if I remember correctly...
 
If that's correct, then the thing you posted is distributed as an F distribution, which is what I need? And would swapping beta.hat for beta.hat-beta make any difference to this?
 

Similar threads

Back
Top