It's simply not true.
In physics, linear algebra and calculus work together quite often to create some rather powerful results. They're both extremely important and without either of them, you could do very little. If one wanted to be particular, though, you can get through first year physics without touching linear algebra, but try getting through any first year physics course without calculus.
Even in quantum mechanics, linear algebra and calculus play equally important roles. (Heck, you can't even comprehend L^2 without linear algebra or calculus, and that's where everything in QM is derived from.)