Now let's calculate an acceleration. I'm going into some messy detail, but assume that you always have sufficient traction. More things can be taken into account, but this will then get complicated very quickly.
Let's say that the static mass of the car is

, and that including rotational inertia gives you

. g is the gear ratio (a positive integer). Now say that the power available at the wheels is

. Here,

is the rotational speed of the engine (i.e. rpm, but possibly in nicer units). Suppose that the actual gear ratios are

(first gear would be largest), the differential ratio is

, and the tire radius is

.
In general, various driveline losses will change depending on gear ratio, but I'll ignore that. They also depend weakly on vehicle speed and the temperatures of the air and various oils, etc etc. On top of that, standard dyno measurements have several systematic errors in them, but I'm just going to say that the dyno measurements are precisely

.
Assuming that the clutch and tires aren't slipping significantly, the (rotational) speed of the engine and the (linear) speed of the car are directly related to each other:
This can also be inverted, so

. Now the mechanical power supplied by the engine goes into accelerating the car and overcoming aerodynamic and other losses. Group the latter conditions into

, so one ends up with an acceleration
This equation can be solved directly to give the time required to accelerate between two given speeds in a single gear:
Generalizing this to include shifting is straightforward, but an important point is that
torque never enters this equation. You could write it in terms of the torque the engine is producing, but it would be more complicated. The interesting thing to note that is that the acceleration at a given speed is always proportional to the power delivered.
Also, if the drag is negligible, the above equation can be written a little differently:
The two limits in the integral are the different rpm's corresponding to different velocities, and

is the torque "at the engine." This equation is nice because the integral depends only on properties of the engine. The driveline is irrelevant. This is as close as you can get to the handwaving idea that improving "average torque" over the rev range makes a faster car.
Edit: I've edited this a bunch of times to fix and add things.