A Continuous output: logistic vs linear regression

AI Thread Summary
Linear regression is preferred for analyzing continuous output data, as it provides a straightforward estimate of the slope and the relationship between variables. Logistic regression is primarily designed for binary outcomes and is less applicable unless the data is strongly bimodal. Dichotomizing continuous data to apply logistic regression may not yield meaningful insights unless clear cutoffs exist. If the data violates OLS assumptions or contains outliers, transforming the response variable to binary could be justified. Overall, linear regression is generally more effective for continuous variables unless specific conditions warrant the use of logistic regression.
FallenApple
Messages
564
Reaction score
61
so say I suspect that there is a positive trend in the data from the scatter plot. Say the output y is continuous.

A linear regression would give me a possitive estimate of the slope. For a one unit increase in x, I would get a so and so increase in y.

I can also split the data for the y variable between high and low, dichotomizing it. And calculate the estimated increase in log odds for a one unit increase in x.

Is there even a point in doing so?

It seems like the question can be answered using linear regression.

I don't see the point in using logistic regression unless the output is necessarily binary (gender, political affiliation etc)

Even if we are interested in a output of,say,having high income vs low income, you can just have income as a continuous spectrum and use ols to get the answer.

Is there something I'm missing?
 
Physics news on Phys.org
Yes, logistic regression was designed for cases with a binary result, like death or loan default. The only circumstance in which I can imagine it might be worth considering a logistic regression for a continuous result variable is where the variable's distribution is strongly bimodal, with nearly all values clustering around one or the other of two widely separated points, and very low probability densities in between. Even then I'm not sure what value it would add, but it might add something.
 
  • Like
Likes FallenApple
andrewkirk said:
Yes, logistic regression was designed for cases with a binary result, like death or loan default. The only circumstance in which I can imagine it might be worth considering a logistic regression for a continuous result variable is where the variable's distribution is strongly bimodal, with nearly all values clustering around one or the other of two widely separated points, and very low probability densities in between. Even then I'm not sure what value it would add, but it might add something.

That makes sense. Because we can meaningfully cut the data and categorize it between high and low values. If the data were not bimodal, then we can't make a meaningful cut and any logistic analysis that follow would only give the log odds of passing that cut, which isn't even valid in the first place.
 
If your data has outliers, or if it violates any assumptions of the OLS regression, and provided you are looking for a binary answer, it could be a good idea to transform the response variable to a binary one and do a logistic regression instead. It would be interesting to compare both though!
 
Last edited:
FallenApple said:
so say I suspect that there is a positive trend in the data from the scatter plot. Say the output y is continuous.

A linear regression would give me a possitive estimate of the slope. For a one unit increase in x, I would get a so and so increase in y.

I can also split the data for the y variable between high and low, dichotomizing it. And calculate the estimated increase in log odds for a one unit increase in x.

Is there even a point in doing so?

It seems like the question can be answered using linear regression.

I don't see the point in using logistic regression unless the output is necessarily binary (gender, political affiliation etc)

Even if we are interested in a output of,say,having high income vs low income, you can just have income as a continuous spectrum and use ols to get the answer.

Is there something I'm missing?

It depends. If you want to spot a trend, check regression. The output will tell you whether there is a "reasonable" linear regression ( if the confidence interval of the slope does not include 0 ); you also check the value of the coefficient r, so that is "high-enough". As Andrew said, logistic regression is most often used in classification: you set up a cutoff point , e.g., you have a yes beyond your chosen cutoff point and a no otherwise.
 
I was reading documentation about the soundness and completeness of logic formal systems. Consider the following $$\vdash_S \phi$$ where ##S## is the proof-system making part the formal system and ##\phi## is a wff (well formed formula) of the formal language. Note the blank on left of the turnstile symbol ##\vdash_S##, as far as I can tell it actually represents the empty set. So what does it mean ? I guess it actually means ##\phi## is a theorem of the formal system, i.e. there is a...
Back
Top