Comparing R^2 from log and level models

  • Context: MHB 
  • Thread starter Thread starter Usagi
  • Start date Start date
  • Tags Tags
    Log Models
Click For Summary
SUMMARY

The discussion centers on the inability to compare R^2 values from two distinct regression models: a log-linear model (ln(y) = β₀ + β₁x₁ + ... + βₙxₙ) and a linear model (y = β₀ + β₁x₁ + ... + βₙxₙ). The primary reason for this limitation is the transformation of the dependent variable in the log model, which alters the scale and interpretation of the R^2 statistic. Consequently, R^2 values from these models reflect different aspects of fit and cannot be directly compared for goodness-of-fit assessment.

PREREQUISITES
  • Understanding of regression analysis concepts
  • Familiarity with log-linear modeling techniques
  • Knowledge of R^2 as a measure of goodness-of-fit
  • Basic statistical transformation principles
NEXT STEPS
  • Study the implications of variable transformation in regression analysis
  • Learn about alternative metrics for model comparison, such as AIC or BIC
  • Explore the concept of pseudo R^2 in logistic regression
  • Investigate the effects of scaling on regression coefficients and interpretations
USEFUL FOR

Statisticians, data analysts, and researchers involved in regression modeling who seek to understand the limitations of R^2 comparisons across different model types.

Usagi
Messages
38
Reaction score
0
Say we have 2 models:

ln(y) = \beta_0 + \beta_1 x_1 + \cdots + \beta_nx_n with a known R^2

and

y = \beta_0 + \beta_1 x_1 + \cdots + \beta_nx_n with a known R^2

Now I know that we can not compare the R^2's from these 2 models to determine goodness-of-fit and I am also aware of how we can manipulate the log model so that we can compare, but my question is, what is the reason for which we can't compare? Obviously the dependent variable is the natural log for the first one and the second model is level in terms of y, but is there a deeper reason? Why is it that if the dependent variable's form is different, then we cannot compare the R^2's between the models?

Thanks
 
Physics news on Phys.org
Deep as you would like, I would think.

http://www.yale.edu/ciqle/Breen_Scaling%20effects.pdf
 

Similar threads

  • · Replies 4 ·
Replies
4
Views
2K
Replies
3
Views
3K
  • · Replies 22 ·
Replies
22
Views
4K
  • · Replies 23 ·
Replies
23
Views
4K
  • · Replies 8 ·
Replies
8
Views
3K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 30 ·
2
Replies
30
Views
4K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K