mikeph, particle is not "going in time", it just is its (action minimizing) trajectory - 1D submanifold of spacetime.
Our "going forward in time" represents reason-result relation chains human world, brains are based on: that we operate on reason-result chains from Big Bang: through Earth creation, evolution, our development.
Big Bang is the anchor for all our reason->result chains. It also was spatially localized - low entropic. As entropy has tendency to grow, it also created the entropy gradient: our 2nd law of thermodynamics.
So as fundamental physics is time/CPT symmetric, could there be also such "anchor" in the future?
Let us assume for a moment
cyclic Universe model - that the Universe will finally collapse gravitationally and "bounce" starting a new Big Bang ... and so on.
So this Big Bounce will be localized and so low entropic - will create 2nd law of thermodynamics, start reason->result chains for this succeeding Universe ...
But let us also look at it toward the past - gravitational collapse caused this low entropic state, so toward the past again entropy should grow. So such Big Bounce should be seen as two Big Bangs: one toward our future and one toward our past - starting Universe evolution in opposite direction.
We can imagine that Lagrangian mechanics chooses action minimizing history of Universe for two fixed points: our Big Bang and our Big Collapse. They destroy nearly all information and symmetry of Lagrangian mechanics would allow to switch them.
Unfortunately, if it would be true, there are trillions of years of thermal death between us, so we rather shouldn't expect any low entropic objects from our Big Collapse.
update: I have just started thread about entropy in the cyclic universe model:
https://www.physicsforums.com/showthread.php?t=712374
ps. Great model to understand the asymmetry is Kac ring - black and white balls in a ring and there are some marked positions. Now in each step rotate all of them by one position, switching color of those which went through a marked position.
Natural statistical assumption ("Stoßzahlansatz"): that total proportion of colors corresponds to proportion before the marked positions, says it should tend to equal distribution of colors (maximal entropy) ... however, making two full rotations we get the initial setting - entropy has to finally start decreasing -
here is nice paper about it.
We can prove e.g.
Boltzmann H-theorem that in classical mechanics entropy always grows ... but making time symmetry of the system we would get opposite conclusion - contradiction. Such "theorems" for time symmetric evolution need to have some hidden extremely subtle assumption, called Stoßzahlansatz.