It probably is that everything is shrinking, actually - after all, the nature of reality is often the opposite of what we intuit, right? Is the apple falling, or is the Earth rushing up to meet it?
How to distinguish experimentally between the two?
Hmmm, here we are, a lovely spring evening, an...