Layman said:
Mach said, as you say (more or less), that the Copernican and ptolemic theories of motion were "equally valid."
I want to comment separately on one aspect of this. What are we actually saying when we say that all frames of reference are "equally valid" in relativity?
Here's how I would put it: *physical laws* must take the same form in all frames of reference. (In special relativity, this is strictly true only for inertial frames; there can be extra terms in the equations in non-inertial frames. In general relativity, it's true without qualification.) Mathematically, physical laws are expressed as partial differential equations involving tensor quantities. So mathematically, the *same* equations for the physical laws must be valid in all reference frames.
However, the equations that express the physical laws have many different particular solutions. Solutions are expressed as numbers, or more generally functions or sets of functions, that describe particular physical entities that obey the physical laws. For example, in the train and embankment thought experiment, the coordinates I gave for each of the events of interest were part of the particular solution (to the physical laws) that describes that experiment. More generally, we could write down functions that describe the entire motion of the train, the embankment, the light emitted by the lightning flashes, etc. And it is perfectly possible for the solution that describes a particular experiment to *change* when we change reference frames. For example, the coordinates of the events of interest will, in general, change when we change frames. That doesn't change the physical laws: those equations are still the same. But the particular solution to those equations that describes the train-embankment experiment is different depending on whether we do it in the train frame or the embankment frame.
(Obviously, changing the "experiment" itself will also change the solution that describes the experiment. The CMBR was mentioned earlier in this thread: there is a particular solution to the Einstein Field Equation, which is the general equation expressing the physical law governing gravity in general relativity, that describes the CMBR as we observe it. But it is perfectly possible, physically, that the CMBR could have had different properties, in which case a different solution would describe it.)
So different solutions will be used to describe the same physical situation in different frames. And there is *no* requirement that those different solutions will describe the situation with equal simplicity, or be equally convenient for calculation. In the Copernican vs. Ptolemaic case, relativity would say that you can, of course, use a frame centered on the Earth to describe the motion of the planets, or you can use a frame centered on the Sun. Both are equally valid. But that doesn't mean that both descriptions are equally simple; the Sun-centered one is much simpler.
There is, actually, a physical fact that this greater simplicity is a reflection of: the solar system possesses an approximate "time translation" symmetry, which means that, to a certain approximation, its physical properties do not change with time--obviously things move relative to one another, but the motions are, to a certain approximation, periodic, so they can be described by a set of parameters that do not change with time. And the Sun-centered description of the solar system is much more closely "aligned" with the time translation symmetry of the system than the Earth-centered description is, meaning that the Sun-centered description comes much closer to being a description that does not change with time (because the motions with respect to the Sun-centered frame come much closer to being exactly periodic and therefore being expressible by a simple set of unchanging parameters). I say "much more closely aligned" because a description that was centered on the solar system's center of mass, which is not the same as the Sun's center, would be even closer to being "aligned" with the time translation symmetry. (I believe such a description is actually used for certain purposes in astronomy.)
So there can actually be physical features of a particular situation that make that situation look simpler in a particular reference frame. (Another example would be the fact that the description of the universe as a whole, including the CMBR but also including many other features such as its expansion, looks much simpler in a reference frame in which the CMBR is isotropic.) That can make such a frame much easier to use, practically speaking; but it doesn't make that frame any more "valid", physically, than any other frame, because the physical laws still look the same in every frame; the fact that some particular solutions to the laws have physical features that make them look simpler in a particular frame is a property of those particular solutions, not of the laws themselves.