Just to note, if you read the methodology of the US News Rankings, you'll find that it's basically a popularity contest. They ask faculty to rate what they think are the best departments, so it's rather fishy in that respect. Though I'd say it helps to get a general feel as to who's pretty good, though looking too closely (like comparing 4th and 5th place) is rather pointless.
GaTech recently got together an astronomy/astrophysics department. GT's computer science is top 10 (for what it's worth) and is a top engineering school, with pretty good physics and mathematics departments as well. Just to add to twofish's list of schools. You might expect engineering schools with good graduate programs in certain fields (like aerodynamics, engines, acoustics/vibrations, materials to some extent, and some others I can't think of right now) to have sufficient access to high performance computers, just as something to help you narrow down your search.