Statements like that are not mathematically precise, so I wouldn't worry about them too much. After all, the metric tensor also has all the information about curvature, since anything else can be expressed in terms of various partial derivatives of the metric.
I think it's a loose way of saying that in everyday operations of differential geometry, and in particular of general relativity, one can derive any piece of info we want about curvature from the Riemann tensor without having to take additional derivatives (which would take the order of differentiation from two to at least three) or taking fancy tensor products (which the Weyl tensor requires).