You can track the relative position of Earth and sun relative to stars - the orbital speed depends on our distance to the sun, if that changes the orbit has to be a (true) ellipse.
You can use observations of other planets as well, but that is tricky as those move significantly within a year.