A good question Dorje, one that exposes a possible inconssitency in GR.
GR is based on SR, which itself is based on the principle of relativity,
there are no preferred frames of reference. From a GR pont of view the SR space-time is empty except for observer test particles of no mass. There are no preferred frames because there is nothing to 'hang your frame on' all frames are equivalent.
However GR considers space-time with a gravitational field, and a gravitational field requires the presence of either mass or energy. If there is mass in the space-time manifold then it is possible to define a special frame of reference - that of the Centre of Mass (CoM) of the system. The question is: "Is the special frame of reference preferred in the same that the laws of physics are different in it than in all other frames, can you identify this frame by performing a laboratory experiment?"
Before we answer this question it is pertinent to observe that in the standard GR theory there are such special frames. In a local gravitational field it is easy to identify the CoM of the system, in the cosmological solution it is easy to identify that frame in which the CMB is globally isotropic and as you point out we are traveling at about 0.1%c relative to the surface of last scattering. Furthermore, in
The Cosmological Twin Paradox the topology of a closed universe does determine a special frame of reference.
There are modifications of GR, the Brans Dicke theory being the most famous, which include Mach's Principle.