To be pedantic, the official mainstream*[/color] mathematical view is that infinity doesn't exist as a number (although, of course, it does exist as an abstract concept). Any statement that includes the word (or symbol for) "infinity" is, strictly speaking, a shorthand convention for a rather more precise statement.
For example, when we say "there are an infinite number of points in a line", that is a shorthand for the more precise statement "there is no upper bound for the number of distinct points we can select from a line".
Given [itex]\gamma = 1 / \sqrt{1 - v^2/c^2}[/itex], we never ought never to say [itex]\gamma = \infty[/itex] when [itex]v = c[/itex], but we can say [itex]\gamma \rightarrow \infty[/itex] as [itex]v \rightarrow c[/itex]. This is itself a mathematical shorthand for the more precise statement that, for any (large) number [itex]\gamma_0 > 0[/itex] it is possible to find a velocity v0 such that, whenever v0 < v < c, then [itex]\gamma > \gamma_0[/itex].
____
*[/color]I say "mainstream" because there may be some esoteric branches of "modern" maths that take a different view.