It is like a movie rating, but only certain members (I think contributers and mentors/admin) can give a rating to a thread. For calculation it is just the average number of stars.
edit... Actually, it looks like contributors can't give ratings anymore