Logistic Regression Interpretation

Click For Summary
SUMMARY

The discussion centers on the interpretation of predicted probabilities in logistic regression, specifically addressing whether the logistic regression model can be considered a likelihood function. The model is defined as E(Y|X)_hat = exp(XBeta_hat)/(1+exp(XBeta_hat)). It is established that while maximum likelihood estimation is used to estimate parameters, the predicted probabilities themselves do not constitute a likelihood function. The likelihood function is defined as L(p|y) = f(y|p), which indicates the probability density function based on the data.

PREREQUISITES
  • Understanding of logistic regression models
  • Familiarity with maximum likelihood estimation
  • Knowledge of probability density functions
  • Basic statistics concepts related to predictive modeling
NEXT STEPS
  • Study the derivation of logistic regression and its applications in predictive analytics
  • Learn about maximum likelihood estimation in depth
  • Explore the differences between likelihood functions and predicted probabilities
  • Investigate the use of logistic regression in various statistical software, such as R or Python's scikit-learn
USEFUL FOR

Data scientists, statisticians, and anyone involved in predictive modeling or interpreting logistic regression outputs will benefit from this discussion.

Ma Xie Er
Messages
12
Reaction score
0
I was trying to find an easy interpretation of the predicted probabilities of a logistic regression model, when one of my coworkers claimed that the logistic regression model is a likelihood.

Now, I know that maximum likelihood estimation is used to estimate the parameters, but I didn't think of the model as a likelihood.

The model is E(Y|X)_hat = exp(XBeta_hat)/(1+exp(XBeta_hat)).

Is the above function a likelihood function?
 
Last edited:
Physics news on Phys.org
Ma Xie Er said:
I was trying to find an easy interpretation of the predicted probabilities of a logistic regression model, when one of my coworkers claimed that the logistic regression model is a likelihood.

Now, I know that maximum likelihood estimation is used to estimate the parameters, but I didn't think of the model as a likelihood.

The model is E(Y|X)_hat = exp(XBeta_hat)/(1+exp(XBeta_hat)).

Is the above function a likelihood function?

I'm going to answer my own question. No, the predicted probability is not a likelihood.

The likelihood is the probability density function, as a function of the data. That is L(p|y) = f(y|p), for a fixed y. The likelihood is telling you how likely p is for a specific value of p, given the data y.

Since the predicted probability does not include all the data (it doesn't include y), you cannot conclude it is a likelihood.
 
Last edited:

Similar threads

Replies
3
Views
3K
  • · Replies 23 ·
Replies
23
Views
4K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 64 ·
3
Replies
64
Views
5K
  • · Replies 16 ·
Replies
16
Views
2K
  • · Replies 12 ·
Replies
12
Views
2K
  • · Replies 9 ·
Replies
9
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K