Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

Can someone explain what is generalized linear model? Examples?

  1. Mar 27, 2012 #1
    What exactly is generalized linear model?

    I understand you have to use the link function.

    Wikipedia says: "The link function provides the relationship between the linear predictor and the mean of the distribution function."
    So, what is this RELATIONSHIP?

    Maybe someone can provide an intuition and example?

    Here I have:
    g(p) = log(p/(1-p))
    Last edited: Mar 27, 2012
  2. jcsd
  3. Mar 28, 2012 #2
    Hi kulimer,

    the idea of the link function is that it transforms the linear predictor so that the mean value of the dependent variable is equal to it, namely [itex]\mathbb{E}[Y] = g^{-1}(X\beta)[/itex], where [itex]X, \beta[/itex] are the regressor and parameter, respectively.

    Let's have the ordinary linear regression. Then, the link function is just an identity, [itex]g(x) = x[/itex]. You get the well-known [itex]Y = X\beta[/itex].

    However, there are dependent variables [itex]Y[/itex] which have some constraints. E.g., [itex]Y[/itex] can be dichotomous, taking values [itex]\{0, 1\}[/itex]. Then the ordinary linear regression will not work and you need to exploit some suitable transformation. And that's what the link function does. By choosing
    g(p) = \log \frac{p}{1-p},
    you get the logistic regression with a logistic (aka sigmoid) function whose range is in [itex][0, 1][/itex], intersecting 0.5 at [itex]p=0[/itex]. So it "models probability" of [itex]p[/itex] being 1.
Share this great discussion with others via Reddit, Google+, Twitter, or Facebook