Talk to someone with no idea of the Maths involved in Physics and you usually hear a pretty poor model of the World. Maths is so crucial to understanding at any but the very superficial level. Imagine trying to have a conversation about Finances without a common knowledge of the Arithmetic of Interest and Profit. The consequence of not using appropriate Maths is constantly being demonstrated by how people are regularly conned into bad deals. The numbers (and the Algebra) always count.
I think many of the preceding comments have been made by people who do, in fact, have an appreciation of the Maths but it is so familiar to them that they are hardly aware of it.