True enough. But, at smaller angles of incidence and refraction, a spherical atmosphere would act more like a converging lens than a prism. This means that, in the ‘lens’ region near the optical axis, the light that passes through would not be subject to the dispersion to which you refer. Instead, it creates the exact visual effect that has been attributed to gravity. Of course, focal length comes into play. But if you don’t believe me, look at something through a magnifying glass. And, that effect has nothing to do with either light dispersion, or any chromatic aberration. Simply put, you may not disregard this consideration if you hope to maintain legitimate credibility, in a purely scientific sense.