Saying there was no 'singularity' would indicate that the universe was formed from nothing. Which is a very big misconception when talking about the Big Bang. There was essentially a singularity according to the Standard Theory of course. A singularity is thought to be at the core of a black hole. Meaning it has infinite density and infinite matter. (the singularity) Before the big bang the universe was thought to be an infinitesimally small, infinitely hot, infinitely dense, something or.. a singularity. Where it came from or why is a question physicists are very soon going to figure out.
Now you can't have something that has matter without gravity. So there is no possible way gravity wasn't present with this singularity when and before it expanded. Also, time doesn't determine if gravity is present or not. Matter does. So, t=0 has nothing to do with gravity being present with this singularity.