I don't think you're alone in that.
Keep in mind that about 120 years ago and before, going back to the dawn of civilization, pretty much everybody with capable eyesight was an astronomer to some degree. There was a lot more walking back then, and using the stars was just something you did to get around after dark. People were keenly aware of the planets (well, Venus, Mars, Jupiter, and Saturn anyway), even if they didn't know what they really were. But they knew that unlike the other "stars," the planets moved around the sky. After the industrial age, with the advent of outdoor, artificial lighting; automobiles; and the corresponding light pollution, things changed; most people don't rely on stars anymore in their day to day lives.
Now I'm always looking up in the sky when I'm out and about. And if I'm loitering around somewhere, and I see something in the sky I find interesting, like one of the planets rising or whatnot, I might point it out to a stranger or acquaintance. On several occasions, the conversation went something like this:
Me: "Look, there's Jupiter," pointing to Jupiter.
Other: "No it's not."
Me: "Uh, yeah, that's Jupiter. You can tell it's a planet because it's not twinkling, and..."
Other: "You can't see Jupiter."
Me: "Sure you can. People have been tracking Jupiter for many thousands of years..."
Other: "Jupiter is just something you see in books and sci-fi movies."
Me: "No really, you can see Jupiter with the naked eye. As a matter of fact, it's one of the brightest objects in the sky actually..."
Other: "It's the North Star."
Me: "... ? ... ," muttering to myself, "Where do I even start with that ... That's not even North ..."
I've met people who grew up in extremely light polluted cities. They were even skeptical of Carl Sagan's "The Cosmos," when Sagan would say something to the effect of, "billions and billions of stars ..." They would say to themselves, "Billions?! What the heck's he talkin' about. There's like eleven of 'em."