I want to study either solid state or relativity. I have taken CalcI-III + odes. I find most of the math I remember is taught to me in physics classes, e.g. Linear algebra in Classical Mechanics, Vectors analysis in EM. Would it hurt me if I didn't take Calc 4 - Vector analysis or PDEs which are optional? I rather focus on my upper level courses in physics.