There is mathematica and there is IEEE754.
IEEE754 is a standard for digital floating point arithmetic. It's purpose is to ensure that every programmed math operation has a well-defined result, even if the operation, such as division by zero, is mathematically untenable.
In IEEE754, infinity is any number that exceeds the maximum floating point value, even by a tiny fractional value, is infinity, but it also raises an overflow exception.
IEEE754 allows division by zero and other operations defined by limiting values, such as log(0), and it will default to infinity as an answer (because generall it makes the most sense), buit it will also raise an exception (it will flag the result as a possible error).
IEEE754 also has +0 and -0, i.e. signed zeros, which do not occur in ordionary arithmetic.
https://en.wikipedia.org/wiki/Signed_zero
Do not confuse mathematics with IEEE754.