@Sassan frankly, this is a ridiculous assertion. There are many gifted and respected physics instructors. The fact that not every professional physicist is a good physics instructor does not imply some elite community disdain for others. Good physicists who are gifted instructors are celebrated as much for their scientific achievements as their pedagogical prowess (eg Richard Feynman).
The same thing happens in every single other field of human endeavor. Not all history scholars are gifted history instructors, capable of making the material accessible to others. Are all historians therefore categorically elites with a disdain for clarity and lucidity?
Insert any other academic subject in place of physics or history. This is a nonsense complaint with 0 validity. It is a false generalization.