I think you might be disappointed with the engineering curriculum and the way engineers do things - I know I did.
Ah, but it's not that simple. Grad school in engineering can be quite different. And really, it is possible to learn engineering in a better way than they tend to teach it. You're just going to be on your own to some degree, figuring it out, but I think that applies to a lot of subjects. I switched from engineering to math and now I sort of regret it. My problems with engineering turned out to be trivial ones. I didn't like the way they did things, but I was able to figure out my own explanations, most of the time, which converted it into something that I liked (and some of it was pretty cool as presented, too. So, then, in my senior year, I finally wasn't able to come up with my own explanations. Out of frustration, rather than just gritting my teeth through one more extremely annoying semester that is not necessarily representative of all of EE, I hastily changed my major to math, unaware that I was walking into a trap in the long run. I think it can be misleading to judge a major based on 2-3 classes that you really hate, and to blame it on the subject, when it's really the presentation that's at fault. You have to keep an open mind.
So, you have to think of a plan that's actually going to work out, and if it's a risky one, have another plan to back up the first one. This is somewhat tongue in cheek, but studying physics is like a lottery where the prize is that you get to work really, really hard. Well, if you're not careful, anyway, that's what it can be.
No matter what you choose, it's going to be a little bit of a gamble, and the more education required, the more of a gamble it will be. It's hard to reach a point where you're really sure that you have made the right decision. At least, I never got to that point, and I have a PhD. Actually, I repeatedly was sure that I made the wrong decision, but then, looking back, I don't know if I did every time. Some people might just think I'm too fussy and won't be satisfied by anything, but the opposite is true because I learned not to sweat the small stuff. My problems with EE were small stuff. My problems with math are BIG, BIG stuff. I learned what it is like to have fundamental, irreconcilable problems with a certain profession. I suppose I'm a bit of a misfit/maverick, though. Anyway, I think part of it is going to be just accepting that there's going to be some risk involved in the choice.