There is a lot of overlap between the two, so I see no reason why you need to choose what you want to study right now. You've got a few semesters, at least every place I've ever heard of, to decide on a major. Take a physics class and see how you do.
Also, why don't you think you're smart enough for physics? If you truly ARE too dumb for physics, you'll also be too dumb for engineering. However, I'm curious why you think that about yourself? That could very well be a self-fulfilling prophecy. I can imagine a situation where you come up against a tough physics problem, and instead of hunkering down and saying "I'm going to get this, hell or high water," you instead say "I guess I'm too dumb for physics, I give up." If that's going to be your mental attitude, don't even try.
As for jobs, if you want to be an actual physicist, you'll need a PhD. However, a BS in physics will still open a lot of doors. A lot of "engineers" today are people with a physics degree. Plus, pretty much any job will look favorably on a physics degree, because a physics degree shows strong problem-solving skills and analytical thinking.