To my knowledge, Baylor does not have a Medical Physics program. You can find a list of CAMPEP accredited programs here:
http://www.campep.org/campeplstgrad.asp
I'm still learning the process, but I believe that to be a Medical Physicist (therapeutic, diagnostic, or nuclear medicine) you must go to and complete a CAMPEP accredited program, additionally you must pass all three parts of the ABR and complete a CAMPEP accredited residency. Again, I may have this process jumbled up a bit.
Honestly, all fields of work have pros and cons. While keeping the job market in mind is wise, I would recommend that you speak with a
medical physicist and look into the variety of careers that
medical physicists go into. The field isn't just clinical, you can also go into academia, research, industry or even a combination of these. You might find that it is a field that you will like regardless of which route you choose, thus leaving you with more career options.
While I was an undergrad I was not completely sure about what graduate programs I would apply for, however I researched and kept up with the requirements of programs that I was interested in and made sure that I took all required AND suggested courses (it is always good to be prepared!). I also suggest that you participate in summer research programs (such as REUs), travel to and present at national physics conferences (APS and SPS are good organizations), and try to publish papers in peer-reviewed journals. All of these things will expose you to a wide variety of fields and give you a better idea of how graduate school will be. Perhaps you'll find yourself doing a 360 (like I did) and going straight back to Medical Physics, or you'll run into something that excites you even more along the way.
Good luck!