Can someone explain what is generalized linear model? Examples?

Join the discussion
Ask a follow-up here, or get your own question answered by working scientists, mathematicians and engineers — people, not an autocomplete.
Real named experts · corrections over time · the nuance an AI answer skips
1 reply · 2K views
kulimer
Messages
9
Reaction score
0
What exactly is generalized linear model?

I understand you have to use the link function.

Wikipedia says: "The link function provides the relationship between the linear predictor and the mean of the distribution function."
So, what is this RELATIONSHIP?

Maybe someone can provide an intuition and example?

Here I have:
g(p) = log(p/(1-p))
 
Last edited:
Physics news on Phys.org
Hi kulimer,

the idea of the link function is that it transforms the linear predictor so that the mean value of the dependent variable is equal to it, namely [itex]\mathbb{E}[Y] = g^{-1}(X\beta)[/itex], where [itex]X, \beta[/itex] are the regressor and parameter, respectively.

Let's have the ordinary linear regression. Then, the link function is just an identity, [itex]g(x) = x[/itex]. You get the well-known [itex]Y = X\beta[/itex].

However, there are dependent variables [itex]Y[/itex] which have some constraints. E.g., [itex]Y[/itex] can be dichotomous, taking values [itex]\{0, 1\}[/itex]. Then the ordinary linear regression will not work and you need to exploit some suitable transformation. And that's what the link function does. By choosing
[tex] g(p) = \log \frac{p}{1-p},[/tex]
you get the logistic regression with a logistic (aka sigmoid) function whose range is in [itex][0, 1][/itex], intersecting 0.5 at [itex]p=0[/itex]. So it "models probability" of [itex]p[/itex] being 1.