Infrared said:
space-time already has coordinates attached to it (spatial and time up to re-scaling and choosing directions)
This is a bit misstated.
Spacetime, considered as a geometric object, is independent of any choice of coordinates, so it's not really correct to say that it "already has coordinates attached to it".
However, it is true that spacetime, considered as a manifold with (pseudo) metric, must have a Lorentzian signature, which means it is always possible to find an open neighborhood of any event in which you can assign three "space" coordinates and one "time" coordinate in the way that is familiar from special relativity. Or, to put it another way, every event has an open neighborhood in which there is a causal structure (spacelike, timelike, and null vectors, light cone) that is the same as the causal structure of Minkowski spacetime, and that causal structure can be used to make the choice of coordinates just described on the open neighborhood.
Once we have the above, all we need in addition is the condition that where any open neighborhoods defined as above overlap, the coordinates on each open neighborhood must be compatible; there must be a valid coordinate transformation from one to the other, meeting appropriate conditions, which would include having the same smooth structure. So once we've chosen a smooth structure on
any open neighborhood, the same smooth structure will end up having to be chosen on the entire spacetime. And of course the choice of smooth structure actually made in GR is the standard smooth structure on ##\mathbb{R}^4##.