Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

Can someone explain what is generalized linear model? Examples?

  1. Mar 27, 2012 #1
    What exactly is generalized linear model?

    I understand you have to use the link function.

    Wikipedia says: "The link function provides the relationship between the linear predictor and the mean of the distribution function."
    So, what is this RELATIONSHIP?

    Maybe someone can provide an intuition and example?

    Here I have:
    g(p) = log(p/(1-p))
    Last edited: Mar 27, 2012
  2. jcsd
  3. Mar 28, 2012 #2
    Hi kulimer,

    the idea of the link function is that it transforms the linear predictor so that the mean value of the dependent variable is equal to it, namely [itex]\mathbb{E}[Y] = g^{-1}(X\beta)[/itex], where [itex]X, \beta[/itex] are the regressor and parameter, respectively.

    Let's have the ordinary linear regression. Then, the link function is just an identity, [itex]g(x) = x[/itex]. You get the well-known [itex]Y = X\beta[/itex].

    However, there are dependent variables [itex]Y[/itex] which have some constraints. E.g., [itex]Y[/itex] can be dichotomous, taking values [itex]\{0, 1\}[/itex]. Then the ordinary linear regression will not work and you need to exploit some suitable transformation. And that's what the link function does. By choosing
    g(p) = \log \frac{p}{1-p},
    you get the logistic regression with a logistic (aka sigmoid) function whose range is in [itex][0, 1][/itex], intersecting 0.5 at [itex]p=0[/itex]. So it "models probability" of [itex]p[/itex] being 1.
Know someone interested in this topic? Share this thread via Reddit, Google+, Twitter, or Facebook

Similar Discussions: Can someone explain what is generalized linear model? Examples?
  1. General Linear Model (Replies: 2)