I know that this is a very old thread, but for what it's worth:
Literally, the same qestion popped up in my head when I watched this talk: http://www.themonthly.com.au/origin-universe-and-arrow-time-sean-carroll-2196. I appreciated all the answers given so far, but I still did not get it. So I...