Buzz Bloom said:
I assume for the purpose of discussing the OP's question that that the speed of light changes, and also the fine structure constant changes
And these two assumptions embody, not only a change in physics, but a change in the choice of units. What we are trying to get you to do is separate these two choices. You cannot say that ##\alpha## changes and ##c## changes, but ##e## and ##h## do not, without making a particular choice of units, whether you realize it or not. But you
can say that ##\alpha## changes without making any choice of units at all. See further comments below.
Buzz Bloom said:
After several iterations of this process, she obtained a result that was "satisfactory". Then she stopped looking for problems in the set up. She realized that if she had not known the "right" answer in advance, she would not know when to stop experimenting.
This happened in at least one significant case historically. Millikan's original oil drop experiment gave a result for ##e## that was different (though not by a lot) from the current value. Other experimenters that tried to replicate his results ended up looking for issues to fix until they got a result that was close enough to his, and then stopping. It took decades for physicists to realize that they should have continued looking for issues to fix because Millikan's value was not quite right.
Buzz Bloom said:
Suppose I made multiple measurements as I described for the speed of light, and over a period of time I found small changes which averaged close to zero, threby suggesting a small distribution range of "experimental errors" with the set up. After a while, on one occasion, an anomalous value was measured. tSubsequently, all measurements were distributed by small amounts close to this anomalous value, with a distribution similar to the original "expeimental errorhe measured values were all close to this new value with a significant change only once, afterwards, the this new value was measured every subsequent time
Then you would have some interesting data which you would need to investigate further. The way to investigate further would be look at other measurements of ##\alpha## using different phenomena that were made over the same time period, to see if they changed, and if so, how. Ultimately you would look for changes in the relationships between the different measurements that could not be explained by mundane factors.
However, there is another aspect of your proposed measurement method that I haven't yet mentioned. When you say that your scheme measures "the speed of light", that is not correct in terms of SI units. As I said before, what it actually measures--the raw number that comes out of the process, before any interpretation is applied to it--is the number of periods of the cesium hyperfine transition that it takes for the light to return after bouncing off the mirror. By the definition of SI units, this is not a measurement of the speed of light, because the speed of light is not measured, it is defined to be the number 299,792,458. So what you are actually measuring, in SI units, is the length of the tunnel in meters. So if the number that comes out of your measurement changes, according to SI units, your hypothesis should not be that the speed of light changed, but that the length of the tunnel changed.
Now suppose that you also have a very long rod that is attached at both ends of the tunnel when you start taking measurements. You attach a very sensitive strain gauge to the rod, so that you can measure very precisely the stress on it; at the start of measurements, the strain gauge reads zero, indicating that, at that instant of time, the rod's unstressed length is exactly equal to the length of the tunnel.
Now consider some possibilities when you find, later on, that the output of your light-mirror setup has changed. If the rod registers a change that corresponds to the change in light-mirror output (for example, the number of periods output by the light-mirror setup increases, and the rod registers tension, indicating that it is being stretched), then you would conclude that the change is due to a change in the tunnel (in the case just described, that the tunnel length is increased). But if the rod strain gauge output does not correspond to the change in light-mirror output (for example, zero stress, or compression, but the number of periods output by the light-mirror setup increases), then you would conclude that ##\alpha## might have changed.
But in the latter case, could you conclude, more specifically, that ##c## had changed, while ##e## and ##h## did not? No, you can't. The internal stresses in the rod depend on ##\alpha##, and they involve interactions between electrons and nuclei in the rod, and quantum energy levels in the rod's atoms, and there is no way, in general, to disentangle all that and say, of the change in ##\alpha##, this much was due to a change in ##e##, this much was due to a change in ##h##, this much was due to a change in ##c##. They are all tangled together, and how you separate them is a choice of units. As I've already said, in SI units ##c## is defined to be constant, so by definition it can't change; so in those units any change in the relationship between the rod strain gauge output and the light-mirror setup output must be due to a change in ##e## or ##h## or both. But if, for example, we took the rod as our standard of length--our unit of length is
defined to be whatever the length of the rod is--then any change in the ratio of rod length (as determined by strain gauge output) to light-mirror number of periods would be by definition a change in ##c## (assuming we keep the SI second as our unit of time). And that change in choice of units would have to also change how much ##e## or ##h## changed given the change in rod strain gauge output and light-mirror setup output. But in all of this, the change in ##\alpha## would be the same--a given change in the relationship between rod strain gauge output and light-mirror setup output means a given change in ##\alpha##, regardless of our choice of units. That is what it means to say that the physics is all in ##\alpha##: the change in ##\alpha## is what tells you how much the stuff you actually observed changed.