Berkeley famously castigated differentials as "the ghosts of departed quantities". In his time, there was no solid mathematical basis for them. Today we have a number of justifications such as those mentioned above that work in various limited circumstances, but none that completely covers the cavalier treatment you will see them subjected to in your physics classes.
Differential forms are the most common means of modeling differentials, but they have severe restrictions, for instance, the differential of arclength
ds = \sqrt{dx^2 + dy^2 + dz^2}
is a nonsensical equation in differential forms - the squaring under differential forms does not behave like a simple multiplication, and the square root can only be interpreted as a notational convention for the equationds^2 = dx^2 + dy^2 + dz^2. In particular, you cannot define a differential form ds by the equation above. But in physics, this sort of thing is done all the time.
There are other models for differentials than differential forms. I once heard about a definition developed by Solomon Leader, based on the Generalized Riemann Integral, that allowed such algebraic manipulations in a natural fashion. It was interesting, but I never heard any more about it.
The fact is, you will see many hard and fast mathematical rules violated freely by physicists, who get away with it, and leave mathematicians scrambling to figure out why. Another classic example is the Dirac delta function. This is a "function", \delta(x), defined by the following properties:
\delta(x) = 0, x \neq 0
\int_{-\infty}^\infty \delta(x)dx = 1
Clearly no actual function has these properties. The first is sufficient to require the integral to equal zero, even if \delta(0) is taken to be infinitely large. Yet the uses the delta function is put to in physics work, and are so useful that the function is also widely used in mathematics. But it required 50 years for mathematicians to come up with a fully functional justification for it.
Some other tricks you will see if follow physics long enough: The derivation of finite values for quantities defined by divergent series, and an integral over an infinite dimensional space which cannot possibly exist, but none-the-less still provides useful answers. Last I heard, not even a weak mathematical justification has been found for these.