A Continuous output: logistic vs linear regression

FallenApple
Messages
564
Reaction score
61
so say I suspect that there is a positive trend in the data from the scatter plot. Say the output y is continuous.

A linear regression would give me a possitive estimate of the slope. For a one unit increase in x, I would get a so and so increase in y.

I can also split the data for the y variable between high and low, dichotomizing it. And calculate the estimated increase in log odds for a one unit increase in x.

Is there even a point in doing so?

It seems like the question can be answered using linear regression.

I don't see the point in using logistic regression unless the output is necessarily binary (gender, political affiliation etc)

Even if we are interested in a output of,say,having high income vs low income, you can just have income as a continuous spectrum and use ols to get the answer.

Is there something I'm missing?
 
Physics news on Phys.org
Yes, logistic regression was designed for cases with a binary result, like death or loan default. The only circumstance in which I can imagine it might be worth considering a logistic regression for a continuous result variable is where the variable's distribution is strongly bimodal, with nearly all values clustering around one or the other of two widely separated points, and very low probability densities in between. Even then I'm not sure what value it would add, but it might add something.
 
  • Like
Likes FallenApple
andrewkirk said:
Yes, logistic regression was designed for cases with a binary result, like death or loan default. The only circumstance in which I can imagine it might be worth considering a logistic regression for a continuous result variable is where the variable's distribution is strongly bimodal, with nearly all values clustering around one or the other of two widely separated points, and very low probability densities in between. Even then I'm not sure what value it would add, but it might add something.

That makes sense. Because we can meaningfully cut the data and categorize it between high and low values. If the data were not bimodal, then we can't make a meaningful cut and any logistic analysis that follow would only give the log odds of passing that cut, which isn't even valid in the first place.
 
If your data has outliers, or if it violates any assumptions of the OLS regression, and provided you are looking for a binary answer, it could be a good idea to transform the response variable to a binary one and do a logistic regression instead. It would be interesting to compare both though!
 
Last edited:
FallenApple said:
so say I suspect that there is a positive trend in the data from the scatter plot. Say the output y is continuous.

A linear regression would give me a possitive estimate of the slope. For a one unit increase in x, I would get a so and so increase in y.

I can also split the data for the y variable between high and low, dichotomizing it. And calculate the estimated increase in log odds for a one unit increase in x.

Is there even a point in doing so?

It seems like the question can be answered using linear regression.

I don't see the point in using logistic regression unless the output is necessarily binary (gender, political affiliation etc)

Even if we are interested in a output of,say,having high income vs low income, you can just have income as a continuous spectrum and use ols to get the answer.

Is there something I'm missing?

It depends. If you want to spot a trend, check regression. The output will tell you whether there is a "reasonable" linear regression ( if the confidence interval of the slope does not include 0 ); you also check the value of the coefficient r, so that is "high-enough". As Andrew said, logistic regression is most often used in classification: you set up a cutoff point , e.g., you have a yes beyond your chosen cutoff point and a no otherwise.
 
Namaste & G'day Postulate: A strongly-knit team wins on average over a less knit one Fundamentals: - Two teams face off with 4 players each - A polo team consists of players that each have assigned to them a measure of their ability (called a "Handicap" - 10 is highest, -2 lowest) I attempted to measure close-knitness of a team in terms of standard deviation (SD) of handicaps of the players. Failure: It turns out that, more often than, a team with a higher SD wins. In my language, that...
Hi all, I've been a roulette player for more than 10 years (although I took time off here and there) and it's only now that I'm trying to understand the physics of the game. Basically my strategy in roulette is to divide the wheel roughly into two halves (let's call them A and B). My theory is that in roulette there will invariably be variance. In other words, if A comes up 5 times in a row, B will be due to come up soon. However I have been proven wrong many times, and I have seen some...
Back
Top