According to Special Relativity, time does not go slower in any rest frame you choose, it only goes slower for objects/observers/clocks that are moving in any rest frame you choose. It's no different than saying that the rocket is moving in the ground's rest frame and the ground is moving in the rocket's rest frame. How is that possible?
But it does help to consider that in the ground's rest frame, the clock on the rocket is ticking slower and it is moving away from the clock on the ground. So between each tick of the rocket clock, as it observes the ground clock, it has moved farther away and so the image of the ground clock's ticks have farther to travel resulting in a longer time compared to its own ticks. It turns out that the ratio of the ground clock's tick interval compared to the rocket clock's tick interval as determined by the rocket is the same as the ratio of the rocket clock's tick interval compared to the ground clock's tick as determined by the ground. Work it out, you'll see that this is true.