Does centering variables for regression always result in unchanged coefficients?

  • Context: Graduate 
  • Thread starter Thread starter monsmatglad
  • Start date Start date
  • Tags Tags
    interaction ols
Click For Summary

Discussion Overview

The discussion focuses on the effects of mean-centering variables in multiple linear regression, particularly in the context of models that include interaction terms. Participants explore whether centering affects the coefficients of non-interaction terms and how this relates to the presence of interactions among variables.

Discussion Character

  • Technical explanation, Debate/contested, Mathematical reasoning

Main Points Raised

  • One participant notes that while centering variables generally does not change coefficients, this may not hold true for non-interaction terms when interactions are present.
  • Another participant seeks clarification on the term "non-integrated variables," which is later corrected to "non-interaction."
  • A participant provides a mathematical model to illustrate how centering affects coefficients, showing that coefficients for non-interaction terms change while those for interaction terms remain unchanged.
  • One participant suggests that the invariance of coefficients under centering is a property of linearity, implying that non-linear interactions may behave differently.

Areas of Agreement / Disagreement

Participants express differing views on the implications of centering in the presence of interaction terms, indicating that the discussion remains unresolved regarding the generality of the effects on coefficients.

Contextual Notes

Participants reference specific mathematical relationships and properties of linearity, but the discussion does not resolve the implications of these relationships on the coefficients in all scenarios.

monsmatglad
Messages
75
Reaction score
0
I am studying mean-centering for multiple linear regression (ols).
Specifically I'm talking about the situation when there is interaction.
When centering variables for a regression analysis, my literature tells me that the coefficients do not change? But when there is some sort of interaction between the variables, the coefficients of the non-interaction terms (the variables that take part in the interaction, but are also represented individually) of the variables do in fact change.

When it is said that when centering the variables, "the coefficients do not change", does that only apply to the non-integrated variables?
 
Physics news on Phys.org
monsmatglad said:
When it is said that when centering the variables, "the coefficients do not change", does that only apply to the non-integrated variables?
What do you mean by 'non-integrated variables'?
 
oops.. Was supposed to be "non-interaction"
 
In that case, yes. Consider the model
$$y_j = a_0 + a_1x_1 + a_2x_2 +a_12x_1x_2 + a_3 x_3+\epsilon_j$$
in which there is an interaction of $x_1,x_2$ but no interactions for $x_3$.
Now centring each variable we get
$$y_j = a'_0 + a'_1(x_1-\bar x_1) + a'_2(x_2-\bar x_2) +a'_{12}(x_1-\bar x_1)(x_2-\bar x_2) + a'_3 (x_3-\bar x_3)+\epsilon_j$$
Rearranging this and matching coefficients to the first equation, we get:
  • ##a_0=a'_0-a'_1\bar x_1-a'_2\bar x_2-a'_3\bar x_3 +a'_12\bar x_1\bar x_2##
  • ##a_1=a'_1 - a'_{12}\bar x_2##
  • ##a_2=a'_2 - a'_{12}\bar x_1##
  • ##a_3=a'_3## [no change]
  • ##a_{12}=a'_{12}## [no change]
So the only coefficients that remain unchanged are those of any variables with no interactions, plus those of any interaction terms.
 
I think this is just a property of linearity, which I believe is equivalent with a lack of interaction between variables, i.e., linearity "preserves translation" , but non-linear interactions do not.
 

Similar threads

  • · Replies 8 ·
Replies
8
Views
3K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 30 ·
2
Replies
30
Views
4K
  • · Replies 13 ·
Replies
13
Views
4K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 4 ·
Replies
4
Views
1K
  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K