Afaik, the justification goes like this:
Although the expression for the perturbative correction is formally infinite, it diverges only logarithmically (~\alpha \ln \frac{\Lambda}{m_{e}}), where \Lambda is the cutoff (some energy scale over which the theory isn't valid), and we know that the...