I thought it was erasing a memory that increases entropy?We feel that way because we feel that it's possible to change the future and impossible to change the past. Why do we feel this way? Because we have memories of the past and none of the future. Why is that? Because storing a memory is a process that increases entropy, and entropy is increasing towards the future. Why is entropy increasing? Because the universe started out in a low entropy state. Why did it do that? No one knows.
I've naively been thinking that we can remember some of the future, in the sense that we can predict it. And the only reason we remember more of the past is that entropy is increasing, due to the initial conditions of the universe.