It's indeed to cancel an infinity. The most simple analogue I can come up with is an integral like
\begin{equation}
\label{1}
I=\int_{\mathbb{R}^2} \mathrm{d}^2 \vec{x} \exp[-(x_1-x_2)^2].
\end{equation}
Obviously that's divergent, because you can just do the ##x_2## integration and get an expression that is independent of ##x_1##. Thus the ##x_1## integral is divergent.
Now, as in the case of gauge invariance, there's first of all a symmetry here: The integrand is obviously independent under translations, i.e., under ##x_1 \rightarrow x_1+a##, ##x_2 \rightarrow x_2+a##, which is the reason for the divergence from the point of view of symmetries. Second it might be that the situation you describe does not care about the individual values of ##x_1## and ##x_2## but only their difference, and what you really want to do is to integrate over this difference. Of course, here it's simple to just do so, but for the gauge invariance it's not that simple, and you have to do this in an indirect way. Indeed, for a gauge theory, it's not the gauge-boson vector fields ##A^{\mu}## but only the whole equivalence class of these fields which are defined as being connected by a gauge transformation. So only these "gauge orbits" are the distinct physical states, and you want to count each gauge orbit only once in the path integral. So instead of the divergent quantity (\ref{1}) we want
\begin{equation}
\tilde{I}=\int_{\mathbb{R}} \mathrm{d} x_1 \exp(-x_1^2), \label{2}
\end{equation}
which is well-defined. So here we choose the gauge fixing ##x_2=0## and integrated only over all distinct situation, given by the values of ##x_1 \in \mathbb{R}##.
So in our analogue situation, the Faddeev-Popov procedure is achieved as follows: First we choose a "gauge condition". Here, we have not much choices, because of the very simple symmetry. We can just fix ##x_2=0## as the gauge condition, and any configuration, equivalent to this one representative of the corresponding gauge orbit is given by the translation,
$$\vec{x}^{(a)}=\begin{pmatrix} x_1 \\ 0 \end{pmatrix}+\begin{pmatrix} a \\ a \end{pmatrix}.$$
The gauge fixing function is
##g(\vec{x})=x_2##.
Now we define
$$\Delta^{-1}(\vec{x})=\int_\mathbb{R} \mathrm{d} a \delta[g(x^a)]=\int_\mathbb{R} \mathrm{d} a \delta(x_2+a)=1.$$
Then we can write
$$I=\int_{\mathbb{R}^2} \mathrm{d}^2 \vec{x} \Delta(\vec{x}) \int_{\mathbb{R}} \mathrm{d} a \delta[g(\vec{x}^{(a)}] \exp[-(x_1-x_2)^2].$$
Now the integration measure ##\mathrm{d}^2 \vec{x}##, the original integrand (the exponential of the "action"), and ##\Delta(\vec{x})## are "gauge invariant". So by making the substitution ##x=y^{(-a)}##, we get
$$I=\int_{\mathbb{R}} \mathrm{d} a \int_{\mathbb{R}^2} \mathrm{d}^2 \vec{y} \Delta(\vec{y}) \delta[g(\vec{y})] \exp[-(y_1-y_2)^2].$$
Now it's easy to see that you get simply the desired value ##\tilde{I}## defined in (\ref{2}) multiplied by a diverging trivial factor, and that's precisely what's also achieved for the functional integrals used in QFT of gauge models, and that's the only thing you need for all practical purposes.