It was that way for me too. Our high school physics teacher expected us to know calculus, and didn't teach us how to do any of it, yet most of us were still taking trig. On the other hand, when I took calculus the following year, I really enjoyed it so much more as each lesson triggered another "Aha" moment of "That's what we were doing last year in physics!" I'm surprised I even passed my high school physics class considering I needed to know calculus I hadn't yet taken.

I thought I hated physics, when in reality, I just hated the way it was taught at an inappropriate level for my math background. There was a huge disconnect between what the physics teacher thought we had as prerequisites, what the math curriculum was actually teaching, and what the course description was that the guidance counselors were following when telling us what courses to take.