No.Two reasons. First, he's speaking to a lay audience, so he can't go on about four-dimensional curved manifolds and metric expansions... he needs some plain English words that kinda sort of convey the right idea, and that's the best he could come up with.
Second, it is possible to expand a spherical surface to any size you want without the expansion proceeding from any single point in the spherical surface. It is true that if you draw a picture or a make a model (such as the surface of a grapefruit) of that expanding spherical surface, you will end up with a three-dimensional ball that has a central point - but that's just an artifact of the picture/model. The spherical surface can be described and analyzed without any reference to any point outside itself.