Black holes do not necessarily have to have infinite curvature, but enough mass to prevent light from escaping its gravitational pull. Infinite curvature would require an infinitely massive object; it's only a theoretical idea and is probably not possible. Einstein didn't believe that space time could rip, but only bend.
If it could exist, it would mean that the space-time continuum was bent to infinity. In case you don't know, the space time continuum can be thought of as a soft surface (such as a mattress), that curves when a mass is on it, and that gives us the impression of gravitational acceleration. It’s a pretty “sketchy” way of thinking about it, but it works.