I think the reasoning is sound, but the Hubble constant is not simply "slightly decreasing". For most of the time, the expansion has been much closer to linear than to exponential.
If I understood correctly, what is observed is a slight acceleration from linear. With time, recession velocities...