More specifically, what I don't get is why the "equivalence between acceleration and gravity" would work if spacetime was curved (or why it wouldn't if spacetime wasn't curved).
Ultimately the problem has to do with we consider to be straight lines. Newton, and I am sure others, observed that undisturbed objects travel in 'straight lines'. From a Newtonian perspective, objects in a gravitational field do not travel in straight lines due to the force of gravity acting on them, and it's all ok.
Let's digress for a moment, and imagine a rifleman in a spinning bowl. The rifleman, sitting in the bowl, shoots out a tracer bullet. From the rifleman's perspective, the bullet travels in a spiral, but, from his past experience he knows that the bullet essentially goes in a straight path. Now, the rifleman can either conclude that there is some force acting on the bullet, or that this spiral path is indeed a straight line. Now, you might (from a Newtonian) perspective, suggest that the Rifleman is in an accelerated reference frame, and that Newtonian mechanics is not valid in accelerated reference frames. However, there does not appear to be any test that can distinguish between gravity and an accelerated reference frame. A force that has the property that it is indistinguishable from an accelerated reference frame is called an 'inertial force'. (Literally, inertial essentially means that the force doesn't do anything.)
From the GR perspective, there are no inertial forces, but instead, space is bent so that the 'straight lines' that undisturbed objects travel along are not necessarily what you would normally consider to be straight lines. It's worth noting that objects traveling at different speeds in a gravitational field are traveling along different paths, so the straight lines have to be different for different speeds. Consequently, it's necessary to have bent space time rather than just bent space.
From a scientific perspective, this notion of bent space time would be considered a curiosity, except that it makes predictions that differ from the predictions made by Newton, and the predictions based on the bent space time notion are more accurate than those made by Newtonian mechanics. Since Newtonian mechanics is already very accurate, and generally simpler to use, it is still quite popular, but when extreme precision is necessary, GR has to be used.