Well first off, the stuff of matter was not so conveniently collected as you say, for in fact matter can be thought of as non-existent prior to the BB. Upon this widely violent explosion, matter itself was in fact created, a process that stemmed from the constant quantum fluctuations occurring...