First, what country are you in? You will only have three semesters of physics courses before you apply to grad school. Even with a BS, you will be short of courses compared to a regular physics major. As you noted, medical physics is quite competitive. I suppose you can leverage your research...