It seems to me that it is easier to start out as a mathematician and become a physicist than the other way round. There are plenty of math specialists branching out into physics, cosmology, etc. How many physics specialists go the other way? Physicists are always seeking mathematicians to help them out. Is this a mistaken view? I feel inclined to focus on math, leaving the door open to a physics career later on.