Going up, the block faced friction and it's own weight, but it's initial velocity overcame that.
Going down, it doesn't have the velocity, but the friction is now facing up, away from the direction the block is moving, and it's "weight" still faces down, which pushes it down the ramp, so to...