Can someone explain what is generalized linear model? Examples?

Click For Summary
SUMMARY

The discussion centers on the concept of the Generalized Linear Model (GLM) and its use of the link function to establish a relationship between the linear predictor and the mean of the distribution function. The link function transforms the linear predictor, allowing for the modeling of dependent variables with constraints, such as dichotomous outcomes. An example provided is the logistic regression, where the link function is defined as g(p) = log(p/(1-p)), effectively modeling the probability of a binary outcome.

PREREQUISITES
  • Understanding of Generalized Linear Models (GLMs)
  • Familiarity with link functions in statistical modeling
  • Knowledge of logistic regression and its applications
  • Basic concepts of linear regression analysis
NEXT STEPS
  • Study the properties and applications of Generalized Linear Models (GLMs)
  • Learn about different types of link functions and their implications
  • Explore logistic regression in-depth, including its assumptions and limitations
  • Investigate other GLM examples, such as Poisson regression for count data
USEFUL FOR

Statisticians, data scientists, and researchers interested in advanced statistical modeling techniques, particularly those working with binary or constrained dependent variables.

kulimer
Messages
9
Reaction score
0
What exactly is generalized linear model?

I understand you have to use the link function.

Wikipedia says: "The link function provides the relationship between the linear predictor and the mean of the distribution function."
So, what is this RELATIONSHIP?

Maybe someone can provide an intuition and example?

Here I have:
g(p) = log(p/(1-p))
 
Last edited:
Physics news on Phys.org
Hi kulimer,

the idea of the link function is that it transforms the linear predictor so that the mean value of the dependent variable is equal to it, namely [itex]\mathbb{E}[Y] = g^{-1}(X\beta)[/itex], where [itex]X, \beta[/itex] are the regressor and parameter, respectively.

Let's have the ordinary linear regression. Then, the link function is just an identity, [itex]g(x) = x[/itex]. You get the well-known [itex]Y = X\beta[/itex].

However, there are dependent variables [itex]Y[/itex] which have some constraints. E.g., [itex]Y[/itex] can be dichotomous, taking values [itex]\{0, 1\}[/itex]. Then the ordinary linear regression will not work and you need to exploit some suitable transformation. And that's what the link function does. By choosing
[tex] g(p) = \log \frac{p}{1-p},[/tex]
you get the logistic regression with a logistic (aka sigmoid) function whose range is in [itex][0, 1][/itex], intersecting 0.5 at [itex]p=0[/itex]. So it "models probability" of [itex]p[/itex] being 1.
 

Similar threads

Replies
3
Views
3K
  • · Replies 13 ·
Replies
13
Views
5K
  • · Replies 22 ·
Replies
22
Views
4K
  • · Replies 9 ·
Replies
9
Views
2K
  • · Replies 7 ·
Replies
7
Views
3K
  • · Replies 8 ·
Replies
8
Views
3K
  • · Replies 23 ·
Replies
23
Views
4K
  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 8 ·
Replies
8
Views
3K