Hmm. We do talk about the independence of physical observables from the choice of coordinates in GR as being a kind of gauge invariance, by analogy with electromagnetism, but thinking about it I'm not sure if the analogy fully holds.
In electromagnetism there are certainly "gauge variant" quantities as distinct from "gauge invariant" ones: the potential A_{u} is gauge variant, but the field tensor F_{uv} is gauge invariant. The reason we say this is that we can change the potential by the gradient of a scalar, A'_{u} = A_{u} + \partial_{u} \phi, without changing any physical predictions; but the reason it doesn't change any physical predictions is that it doesn't change the field tensor F_{uv} = \partial_{u} A_{v} - \partial_{v} A_{u} (because mixed partial derivatives commute), and the field tensor is what determines the physical predictions.
In the case of gravity, the analogue of a "gauge transformation", a change of coordinates, can change the components of the things that actually determine physical predictions, such as the electromagnetic field tensor F_{uv}; the reason it doesn't change the actual physical predictions is that those predictions are expressed as scalars, i.e., contractions of vectors and tensors, and those do not change with a coordinate transformation, even though the individual components do. So in this case, we could say that the vectors and tensors themselves are the "gauge variant" quantities, and only the scalars are "gauge invariant"; but "gauge variant" here has a different meaning than it did in the electromagnetism case, because the things we are calling "gauge variant" are directly used to make physical predictions, not indirectly as in the electromagnetism case.