That's not true. Good intuitive understanding of physics can help you make right decisions in a tight spot. Understanding the reasons why certain limitations are in place is also a good thing.
Granted, it's far from the most important thing for a pilot, but it helps. Being a physicist meant that passing theoretical was just a matter of memorizing regs. Making all necessary computations and learning the systems was a snap. I still don't have the hours for a license, but I have flown, and it was a lot easier for me to get used to flying than it is for most people.