All engineering needs math. You can try for a job that is more hands on than theoretical. Engineering Technician, electronic technician, or other kind of technicians doesn't require as much math as engineering but will pay as much, if you work overtime.
I think you have to learn geometry to graduate from high school, but it is a simple version of trigonometry. You definitely need trigonometry and calculus, if you want to be an engineer. Basically, you need every single math class, even statistic.
Well, from my experience, Engineering technology is easier to find a job than Physics. If your goal is to get a job after you graduate, that is.
Physics is a good major to get into if you are into education. You will learn a lot more, and it is harder than engineering technology.