Can someone explain what is generalized linear model? Examples?

In summary, Generalized Linear Models (GLMs) are a type of regression model that uses a link function to relate the linear predictor to the mean of the dependent variable. This is necessary when the dependent variable has constraints, such as being dichotomous. The link function transforms the linear predictor so that it can accurately model the probability of the dependent variable's values.
  • #1
kulimer
9
0
What exactly is generalized linear model?

I understand you have to use the link function.

Wikipedia says: "The link function provides the relationship between the linear predictor and the mean of the distribution function."
So, what is this RELATIONSHIP?

Maybe someone can provide an intuition and example?

Here I have:
g(p) = log(p/(1-p))
 
Last edited:
Physics news on Phys.org
  • #2
Hi kulimer,

the idea of the link function is that it transforms the linear predictor so that the mean value of the dependent variable is equal to it, namely [itex]\mathbb{E}[Y] = g^{-1}(X\beta)[/itex], where [itex]X, \beta[/itex] are the regressor and parameter, respectively.

Let's have the ordinary linear regression. Then, the link function is just an identity, [itex]g(x) = x[/itex]. You get the well-known [itex]Y = X\beta[/itex].

However, there are dependent variables [itex]Y[/itex] which have some constraints. E.g., [itex]Y[/itex] can be dichotomous, taking values [itex]\{0, 1\}[/itex]. Then the ordinary linear regression will not work and you need to exploit some suitable transformation. And that's what the link function does. By choosing
[tex]
g(p) = \log \frac{p}{1-p},
[/tex]
you get the logistic regression with a logistic (aka sigmoid) function whose range is in [itex][0, 1][/itex], intersecting 0.5 at [itex]p=0[/itex]. So it "models probability" of [itex]p[/itex] being 1.
 

FAQ: Can someone explain what is generalized linear model? Examples?

1. What is a generalized linear model (GLM)?

A generalized linear model is a statistical model that is used to analyze relationships between a response variable and one or more explanatory variables. It is a generalization of the linear regression model, as it allows for a wider range of response variables and can handle non-linear relationships between the variables.

2. How is a GLM different from a linear regression model?

A GLM is different from a linear regression model in that it allows for a wider range of response variables, such as binary or count data, and can handle non-linear relationships between the variables. It also uses a link function to transform the response variable and allows for different error distributions.

3. What are some examples of GLM applications?

Some examples of GLM applications include analyzing the relationship between income and job satisfaction, predicting the likelihood of a patient developing a certain disease based on their demographic and lifestyle factors, and understanding the effects of different marketing strategies on sales.

4. How do you interpret the results of a GLM?

The results of a GLM can be interpreted by looking at the coefficients for each explanatory variable, which represent the relationship between that variable and the response variable. These coefficients can be positive or negative, indicating a positive or negative effect on the response variable. The p-value associated with each coefficient can also be used to determine the significance of the relationship.

5. What are some common assumptions of GLMs?

Some common assumptions of GLMs include the linearity of the relationship between the variables, the independence of the observations, and the normality of the error distribution. It is important to check these assumptions before interpreting the results of a GLM.

Back
Top