PeterDonis said:
The timelike ordering is not "smaller than" and "larger than"; it is "before" and "after". These are symmetric in the same way that "north of" and "south of" are in
@DrGreg's example. You don't have to have a concept of "size" of items to have an ordering. You just have to have a relation that satisfies the properties of an ordering relation.
Sure, the "real line" can be ordered in the one or the other way, and if this "real line" models a spatial direction, there's not so much different in choosing the one or the other ordering. If the "real line" models a temporal direction, that's a different business in physics, because we assume that there is a "causal ordering", i.e., that if one event is the cause of another event these events must be ordered such that the cause is "before" its "effect". In my opinion that's a basic assumption behind all of physics since without causality it wouldn't make sense to look for "natural laws" to begin with.
That's also what's behind the math of relativistic space-time manifolds being not "Riemannian" but "pseudo-Riemannian" manifolds with a fundamental form of signature (1,3) (or equivalently (3,1)): It's because this enables to establish a "causal ordering" in the sense of "time ordering" in contradistinction to any possible "spatial ordering".
Take special relativity as an example and the derivation of the proper orthochonous Poincare group as the symmetry group of special relativistic spacetime this argument with "causal/temporal ordering" is important.
If you just start from the assumption of the special principle of relativity, i.e., the assumption that there are (global) inertial frames and that time is homogeneous and the space as observed by any inertial observer is a Euclidean 3D manifold, you get first 3 possible symmetry groups, the Galilei-group (leading to the spacetime model of Newtonian physics, which is a fiber bundle), the Poincare group (the spacetime model of special relativity, which is an affine pseudo-Euclidean space with a fundamental form of signature (1,3) or (3,1)), or the group ISO(4) (leading to a 4D affine Euclidean manifold), but this latter possibility is ruled out due to the fact that then, to have a full group as the symmetry transformations, you can't establish a causal/temporal order.
For details, see, e.g.
V. Berzi and V. Gorini, Reciprocity Principle and the Lorentz
Transformations, Jour. Math. Phys. 10, 1518 (1969),
https://doi.org/10.1063/1.1665000