Graduate Does Delta Method work for asymptotic distributions?

Click For Summary
SUMMARY

The discussion centers on the application of the Delta Method for deriving confidence intervals in logistic regression when the outcome is known, specifically with an odds ratio of 5. The participants confirm that the estimated coefficients, represented as ##\hat{\vec{\beta}}##, follow an asymptotic normal distribution, ##N( \vec{\beta}, \hat{{Var{\hat{\beta}}}})##, for large sample sizes. The formula derived for the predictor x is ##x( \beta_{0},\beta_{1}) =\frac{ log(5)-\beta_{0}} {\beta_{1}}##, indicating that the Delta Method can be applied despite the variance covariance matrix being estimated. The discussion concludes that the Delta Method remains valid under these conditions, allowing for Taylor expansion to simplify variance calculations.

PREREQUISITES
  • Understanding of logistic regression and odds ratios
  • Familiarity with the Delta Method in statistics
  • Knowledge of asymptotic distributions and variance covariance matrices
  • Proficiency in Taylor series expansion
NEXT STEPS
  • Study the application of the Delta Method in logistic regression
  • Learn about estimating variance covariance matrices in regression models
  • Explore advanced topics in asymptotic statistics
  • Review Taylor series expansion and its applications in statistical inference
USEFUL FOR

Statisticians, data scientists, and researchers involved in regression analysis, particularly those working with logistic regression and interested in confidence interval estimation methods.

FallenApple
Messages
564
Reaction score
61
So if I have a logistic regression: ##log (\hat {odds})=\hat{\beta_{0}}+\hat{\beta_{1}}x##. How would I find a confidence interval for x if I am given ##odds=5## This is going in reverse, where if I have the outcome, I try to do inference on the predictor.

We know that ##\hat{\vec{\beta}}##, the vector of ##\hat{\beta_{0}}## and ##\hat{\beta_{1}}##, is distributed asmptotically as ##N( \vec{\beta}, \hat{{Var{\hat{\beta}}}})## for large sample sizes where ##\hat{{Var{\hat{\beta}}}}## is the estimated variance covariance matrix.( similar to how ##\sigma^{2}## is estimated by ##s^{2}## for the basic t test).

So solving for x using ##log (5)=\beta_{0}+\beta_{1}x## I get: ##x( \beta_{0},\beta_{1}) =\frac{ log(5)-\beta_{0}} {\beta_{1} }## a multivariate function of both parameters.

So it seems that I would use the delta method but the one problem is the variance covariance matrix is an estimated one, so it doesn't have any actual parameters in it. Would delta method still work for this? Or would I need to try another method?
 
Physics news on Phys.org
No, that's ok. The point is that you can Taylor expand ##Var_\beta=Var_\hat{\beta}+(\partial Var_\beta/\partial \beta )(\hat{\beta}-\beta)+\ldots##.
Now ##\hat{\beta}-\beta## is of order ##1/\sqrt{N}##, so that asymptotically, you can neglect the second term.
 
  • Like
Likes FallenApple
If there are an infinite number of natural numbers, and an infinite number of fractions in between any two natural numbers, and an infinite number of fractions in between any two of those fractions, and an infinite number of fractions in between any two of those fractions, and an infinite number of fractions in between any two of those fractions, and... then that must mean that there are not only infinite infinities, but an infinite number of those infinities. and an infinite number of those...

Similar threads

  • · Replies 2 ·
Replies
2
Views
1K
Replies
3
Views
3K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 8 ·
Replies
8
Views
2K
Replies
3
Views
1K
Replies
1
Views
4K
  • · Replies 1 ·
Replies
1
Views
2K
Replies
0
Views
886
Replies
1
Views
3K
  • · Replies 1 ·
Replies
1
Views
2K