For a particle radially infalling towards a schwarzschild black hole, we have:
[tex]\frac{dr}{dt}=-\left(1-\frac{2M}{r}\right)\sqrt{\frac{2M}{r}}[/tex]
You can easily integrate this to find t(r), and indeed you will find that the time it takes for an object to go from any finite distance to the event horizon (limits of integration r=x*M to r=2M), is infinite. Without integration, simply note that the quantity dr/dt is the velocity measured by our distant observer, and this goes to zero as r-> 2M.
This isn't a problem though, as it doesn't mean a black hole can never gain mass. We define the black hole's mass through the radius (or area, whichever you like) of its event horizon. The event horizon is a mathematical boundary which responds to infalling mass before it has crossed the horizon. Since the EH is the boundary which outgoing light rays will never reach infinity, it is NOT the boundary at which outgoing light rays are immediately "bent backwards"! (This is instead referred to as the Apparent Horizon).
The distinction is a bit tricky and it's difficult to explain "why" the event horizon expands prematurely. One reason is that we have certain theorems that state that the event horizon must evolve continuously. Therefore, it cannot suddenly increase in size as mass passes the old event horizon boundary. A more physical way, perhaps, is to imagine you have an outgoing light ray just above what you think is the event horizon. As the infalling mass passes the light ray, the 'gravitational pull' felt by the ray increases, and if it is enough the light ray will end up bending back in towards the black hole. Therefore, the light ray was launched from inside the horizon, i.e it expanded before the matter got there.
I realize my little example has some analogies with Newtonian physics and whatnot, but it's actually a good way of understanding the process that's going on.