The chances are slim, but anybody here know the University of Waterloo Engineering Department enough to know if EE+physics double major would be possible without taking a decade? Seems like many uncommon courses.
It depends on the school and department but I think it would be doable in 5 years if not 4. Not saying it'll be easy, though. There is a lot of work in both majors.
Minoring on the other hand, as hiddenmist said, would be possible and can even be recommended, especially if your thinking of going into experimental physics. The knowledge of electronics and instrumentation learned in an EE minor would be of great benefit when working in a physics lab.
i might recommend Physics/Math as an undergrad major, take the necessary Calc, Diff Eq that are in common with both Physics and EE, take additionally Complex Variables, Probabiliy Theory, Matrices and Determinants as whatever math electives that you can apply to your Physics/Math degree, take maybe 3 or 4 junior level EE courses that you will need to get into a graduate EE program (but you won't need to take EM fields in the EE dept.) and then, with most schools, nearly all of those senior level EE courses, you can take for graduate credit as a grad student (as long as you take sufficient grad level course for credit). when you get your Masters, it could turn out that you might want to continue EE (for a PhD) somewhere else (or you'll get accepted only someplace else). usually you will get a year credit for the PhD program for your MS, but if you did EE the whole way, there might be significant overlap between the two grad programs, even if one was for an MS and the other for a PhD.