You are forgetting that these are mathematical notation in most cases. These are the TOOLS!
You are also forgetting that someone could also say that all of language is nothing more than letters and symbols. How accurate do you think that would be?
The mathematics used to express physics is extremely accurate in terms of expressing the IDEA. Using words are never as accurate. Try it. Tell me in words how the electric field of an infinite line charge varies as a function of distance from the line charge. I can bet you that expressing it in mathematical form is a lot more compact and accurate.
Many people do not complain when one is required to learn musical notations when studying music. People also do not confuse those notations as being the music itself but rather a representation of the sound. So why can't people also see the same thing with mathematical representation? Most physicists and enginners read mathematical experessions almost the same way musicians read musical notes. We don't just look at the symbols, but rather what is represents. The major difference between these mathematical symbols and musical symbols is that mathematical expressions can be logically manipulated and operated on that can still reflected physical ideas.
So yes, we DO need those "funky" notations, the same way you need a larger range of vocabulary to accurately and clearly express your ideas.
Zz.