Something else I would consider instead of rankings:
Not to doubt your desire for physics or anything, but there is a possibility you might change majors once you get into college. I entered as Chem. engineering and changed mine 3 times (counting adding majors) and I've ended up as a double in chemistry and physics. I still have all the same interests, I just found out that I like the work of scientists more than engineers. Something that's hard to know until you get the experience.
My advise: Pick your college based on other factors as well. You will be spending 4+ (nothing wrong with +!) years there AND make lasting memories.
Think about if you would prefer a big school or small school.
Big school or big physics program: Good choice if you are competitive/rise to the top easily/outgoing. Keep in mind you might have classes with hundreds of people at first and they'll get smaller as you get into your major.Big schools have impressive rankings and reputation. This makes it easy for graduate schools and employers to make quick judgements on your education. You can also meet bigger names in your desired field and have more a large variety of research to get involved with. However,there will be a lot of smart cookies with a lot of desire you will have to beat out to get research positions or leadership positions/scholarships. Some big name schools have GPA inflation. Non-acedemic wise, you'll find a lot of people with similar interests and a lot more fun stuff to do on/around campus!
Small school (or teaching non-research schools): These schools don't graduate students so the classes are all taught by full-ledge professors almost always with Ph.Ds. Your classes, for example, could have around 60 people freshman year and maybe only 10 for upper division. These schools are good for people who maybe smart and enjoy leading, but maybe need encouraging to get into leadership spots. You get the opportunity to develop close relationships with your professors and peers. They also usually have quite a few research opportunities open compared to research schools. However, because they're small they may not have specifically what you would like to do.
I'm sure you've heard this already, but I thought I would give you my thoughts. If you haven't made your decision on this matter yet, keep it in your mind as you are deciding. I didn't and I went to a teaching uni close by to save money. It turned out to be a perfect fit so I stayed.