If I went into, say, biology or computer science, plenty of people would be interested in what I do (by people, I usually mean curious educated people). After all, biology permeates many topics in daily life, as does computer science (since so many subjects now depend on various CS topics). But with astrophysics, most people (even curious educated people) don't even care very much about it. They might have skimmed through the "Brief History of Time", or find curiosity in topics like astrobiology and the big bang. But most astronomy research isn't about those things. Most astronomy research is about things like stars and galaxies. They may ask you "hey, what's the significance of, say, studying the metallicity content of a certain group of M-dwarf flare stars that are in this bubble in the Milky Way?" And of course these is a significance to studying this, but this significance is really only appreciated by astrophysicists. Sure I could say a few things about astrobiological implications, but that's really an extremely minor part of the significance of studying those stars. That being said though, maybe there are people in other groups who have a remarkable curiosity about astronomy (since astronomy, is after all, the best example of what's extreme and what's possible). After all, we see a lot more amateur astronomers than amateurs in a lot of other fields of science.