For an undergraduate physics degree, the most important things are calculus (both single-variable and multivariable) and differential equations. Some linear algebra and probability/statistics also help.
For graduate study, add complex analysis and group theory.