While it isn't a bad thing, you should go into a physics major with an open mind of trying everything you can as there are so so many fields in physics (not saying youre not though)
Its hard to explain tbh if you haven't done some of it but you really have no idea whether or not youre going to enjoy these topics until you get into them more, reading about the topics and the maths behind it is completely different to actually doing it for yourself. Things like quantum mechanics, QFT, string theory, areas of advanced maths etc you don't really know if you will enjoy until you start doing it, I can't really explain it in a way that someone who has had no formal exposure to it will understand but until you're there and actually having a go yourself with all the correct tools needed (the maths) you won't know if you like it or not.
But hell I don't blame you for thinking the way you do, I think most people go into undergrad thinking QM, QFT, GR, advanced maths etc is going to be amazing but not so many actually do enjoy it in the end, lots end of preferring experimental physics (which they went in thinking they would hate), solid state physics, biophysics, atmospheric physics, medical physics, other areas of condensed matter, QI etc there are so many areas that you won't of heard of til you get there.
Another thing is as well (others can either agree or disagree), you have to be in the top portion of your cohort to excell in these area youre interested in, not only is it competitive to get a phd in but the topics are just really really really hard and abstract, again you won't know how you take to it until you do some. If the US system is similar for high school as in the UK then you won't really of done anything that is remotely difficult physics wise tbh