FYI, there is another way of looking at this, which is the superposition principle (a very useful principle overall if I might add).
So, you know that the electric field inside the conductor is zero. The way to look at it is by rather saying "the electric field *does* permeate the conductor, but additionally, the conductor creates a field inside that is the exact opposite."
The net result (of course) is still that the field inside is zero, but now you can look at the field *outside* the conductor as a sum of two electric fields: the initial one, and the one from the conductor. So, you ask yourself, what does the electric field look like on the outside of the conductor when I know it has this "opposite field" on the inside. If you add both outside electric fields together, you see that it then results in that "reflection" behavior.
If I remember correctly, when you do the math, you also accidentally deduce Snell's Law.