Estimating Parameters in Multivariate Regression

TranscendArcu
Messages
277
Reaction score
0

Homework Statement



Skjermbilde_2012_07_02_kl_11_37_49_AM.png


The Attempt at a Solution



So I was wondering whether or not, in an instance of n observations and k explanatory variables, where the following is an accurate statement:
Code_Cogs_Eqn.gif


That is, the estimate of beta_1 found by only regressing y on x_1 is equal to the the true multiple regression, beta_1_hat plus all the effects of the x_j on y (the beta_j's) times the slope estimate found by regressing x_j with j≠1 on x_1.

Apparently this is not true, and the following explanation was offered:

"[This equation] turns out to only be correct in some very specific circumstances. The problem is that we have to account for correlations between all the x's. So it's not just the correlation of x1 with x2 and the corr of x1 with x3 that matters, but also the corr of x2 with x3 will play a part. So there would have to be additional terms that allow for that. "

I'm just wondering if these additional terms with be positive if x2 and x3 are highly correlated, and zero if they are uncorrelated. Can anybody help me with understanding this?
 
Physics news on Phys.org
I'm just thinking out loud here, but might it be conceivable to write the following equation for the general case:

\tilde{\beta}_1 = \hat{\beta}_1 + \Sigma_{j=2}^k (\hat{\beta}_j) \frac{\Sigma_{i=1}^n x_{1i}(x_ji - \bar{x}_j)}{\Sigma_{i=1}^n x_{1i}(x_1i - \bar{x}_1)} + \Sigma_{j=2} ^k Err[corr(x_1,x_j)]

Thus, we would have an "error term" (maybe error is the wrong word to use) that accounts for the correlation of x1 and xj. What do you guys think?
 
There are two things I don't understand about this problem. First, when finding the nth root of a number, there should in theory be n solutions. However, the formula produces n+1 roots. Here is how. The first root is simply ##\left(r\right)^{\left(\frac{1}{n}\right)}##. Then you multiply this first root by n additional expressions given by the formula, as you go through k=0,1,...n-1. So you end up with n+1 roots, which cannot be correct. Let me illustrate what I mean. For this...
Back
Top