If I really thought that philosophers did not say anything meaningful then I would put them in the same category as raving lunatics. Do you look down on raving lunatics? Let's leave mental illness out of this, let's say that they choose to be lunatics (actually I guess that is the popular definition of a philosopher).
Maybe it is just a language problem; do you look up to some professions more than others ? Then, if later in life you belonged to one of the professions that you held in higher esteem but your rankings had stayed the same, wouldn't you then be looking down on the careers that you previously had looked up to less?
For example, I certainly don't think being a chemist is a bad thing. When I was young I could say "I look down at criminals and capitalists, I look up to chemists and engineers, and I look up to to physicists to an even greater degree." Now that I am a physicist I am required to 'look down' at chemists in order to maintain self-consistency, but that doesn't mean that I think chemist are bad, just less good.