When we talk about "star colors" we actually mean the spectrum that it emits. We are very easily able to measure this spectrum to a very very high accuracy.
You make it sound easy, but from a quick look into how star colors are measured, it doesn't look so easy. I looked at this site to start with:
http://outreach.atnf.csiro.au/education/senior/astrophysics/photometry_colour.html
Then I looked at the SOLAR payload on board the ISS, the SOLSPEC experiment in particular:
http://www.nasa.gov/mission_pages/station/research/experiments/Solar-SOLSPEC.html
and a more detailed pdf file:
http://lasp.colorado.edu/sorce/news/2008ScienceMeeting/doc/Session1/S1_04_Thuillier.pdf
I'm no scientist so excuse my perhaps naive questions. SOLSPEC does have error margins, and needs regular calibration. It is also looking at the nearest star, so is quite large. The next nearest star though, and all the others, are only going to resolve to 1 pixel even from our most powerful instruments, aren't they? How can a similar accuracy be claimed? I'm not saying it can't, but if there is indeed an easy explanation, I'd be interested to know.
Secondly, if we are examining spectra, through filters, how is it determined that the spectra are thermal in origin rather than from ionisation of elements in a stars electric field? If we look through a red filter, how do we know that we are not seeing a Balmer line of hydrogen?
And lastly, what about Stark or Zeeman shifting, does those come into play in these measurements?
(Dons flak jacket and stands well back...)