Even if the rocket traveled "straight up", the surface of the Earth is turning, which carries the observer away from the origin of the trajectory. In this respect, it is the observer who moves horizontally with respect to the rocket rather than the other way around. To this visual effect, add...