What city?
In the US, one would have to contact NOAA or better the National Climate Data Center.
http://www.ncdc.noaa.gov/oa/ncdc.html
One can locate weather stations by zip code, or other means, e.g., county.
As far as I can tell, there will be a cost, and not all information will be available, particularly as one goes further back.