If the cylinder has finite length, the field inside is zero only at the "center of the center", by symmetry considerations, and this even if the cylinder is not empty. If the cylinder has infinite length, then the field inside is zero not only along the axis, but in the whole region where there is no mass. The proof is the Gauss or divergence formula and the fact that for the gravitational field