How to Find the Variance of O hat1 in a Multiple Regression Model?

Click For Summary
SUMMARY

The discussion focuses on estimating the variance of the sum of coefficients in a multiple regression model, specifically O hat1 = B hat1 + B hat2, where B hat1 and B hat2 are the estimated coefficients for independent variables x1 and x2. The participants confirm that O hat1 is an unbiased estimator of O1, as E(O hat1) equals E(B hat1) + E(B hat2). The variance of O hat1 is derived using the formula Var(O hat1) = Var(B hat1) + Var(B hat2) + 2Cov(B hat1, B hat2), with a request to express the covariance in terms of the correlation coefficient Corr(B hat1, B hat2).

PREREQUISITES
  • Understanding of multiple regression models
  • Familiarity with statistical concepts of variance and covariance
  • Knowledge of correlation coefficients
  • Ability to apply the properties of expected values
NEXT STEPS
  • Study the derivation of variance in multiple regression models
  • Learn how to express covariance in terms of correlation coefficients
  • Explore the implications of unbiased estimators in regression analysis
  • Review the properties of random variables in statistical analysis
USEFUL FOR

Statisticians, data analysts, and students studying regression analysis who need to understand variance estimation in multiple regression models.

jasper90
Messages
16
Reaction score
0
Consider the multiple regression model containing three independent variables
y = B0 + B1x1 + B 2x2 + B 3x3 + u
You are interested in estimating the sum of the parameters on x1 and x2; call this O1 = B1 + B 2
a) Show that O hat1 = B hat 1 + B hat 2 is an unbiased estimator of O1.
b) Find V ar(O hat 1) in terms of Var(B hat 1), Var(^B hat 2), and Corr(B hat 1, B hat 2).

I get that for a) E(O hat1)= E(B hat 1 + B hat 2) = E(B hat 1) + E(B hat 2) = B1 + B2 makes it unbiased, but I am not sure what to do for b)


help please

should I post this in a different section?
 
Physics news on Phys.org
mainly looking for help in B)...where do I even start?
 
jasper90 said:
mainly looking for help in B)...where do I even start?

Use the standard formula for the variance of a sum of random variables; see, eg.,
http://en.wikipedia.org/wiki/Variance .

RGV
 
ok, thank you, so now i have this

Var( O hat) = var( B hat 1 + B hat 2) = var( b hat 1) + var( b hat 2) + 2 Cov( B hat 1, B hat 2)

Now, I am supposed to have this in terms of Corr(B hat 1, B hat 2) also, how do I do that?

This may sound dumb, but since Corr(x, y) = (cov(x,y))/( square root( var(x) var(y))...can i just multiply the whole right side of my equation by square root( var(x) var(y)) / square root( var(x) var(y)) then that would allow me to have the last term as 2Corr(x, y) square root( var(x) var(y)) ?
 
Last edited:
jasper90 said:
ok, thank you, so now i have this

Var( O hat) = var( B hat 1 + B hat 2) = var( b hat 1) + var( b hat 2) + 2 Cov( B hat 1, B hat 2)

Now, I am supposed to have this in terms of Corr(B hat 1, B hat 2) also, how do I do that?

How do you relate Cov to Corr? (It's in the book!)

RGV
 
Ray Vickson said:
How do you relate Cov to Corr? (It's in the book!)

RGV

Hi, I just editted my previous post, is that right?
 
does my previous post look right?
 
help?
 

Similar threads

  • · Replies 11 ·
Replies
11
Views
2K
Replies
10
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 10 ·
Replies
10
Views
1K
  • · Replies 2 ·
Replies
2
Views
2K
Replies
1
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 23 ·
Replies
23
Views
4K
  • · Replies 1 ·
Replies
1
Views
2K
Replies
4
Views
5K