You'd better do it now, before physicists discover even more physics for you to take.
You think Einstein had to take Modern physics or Quantum Mechanics? Nope. So, the sooner you get it over with, the less you'll have to learn.
EDIT: Looked over the course list. It's not really that bad. Especially since some of them are "repeats" (same title, different year). And like others have said, a lot of those other courses are simply optional depending on what you want to do later in your career. I wouldn't take, for example, statistical physics in biology. I just don't see myself doing biology. It makes me squeemish. :( But instead I would take say the theory of solids classes.
Here is a list of physics classes offered at UW:
http://www.washington.edu/students/crscat/phys.html
A lot of those are graduate level, and a lot of those are total BS classes, like Phys 215 "A Way of Knowing.", so we would't be expected to take them.
The general list of classes you need to take to graduate with a BS degree, though, isn't that bad:
http://www.phys.washington.edu/bsrequirements.htm