Thanks to everyone who replied. K^2 and Driftwood's answers were the ones for which I was looking. It's not that the using the contact point as the axis is invalid, it's just that, as K^2 said, the angular velocity about that point is increasing due to the torque, but in this case all that...