Well I am not so sure.
Let us examine the situation more closely.
Gravity exerts a body force on matter. It can be exerted on a single point mass. It does not directly exert pressure.
Pressure is not a force it is a surface action. Its action is such that two or more bodies in contact experience a contact force. Pressure is numerically equal to this force divided by the contact area. It requires at least two masses to achieve this action.
So let us look first at the surface of the earth.
There is most definitely a force due to gravity here, but does any mass at the surface of the Earth experience pressure?
Now let us delve into the interior. As I understand it, a mass somewhere in the interior experiences the above mentioned contact force from the material 'above' it as pressure.
Now consider a point mass just to the left of the centre of gravity.
Because it is off centre there is more mass to the right than to the left, yet it experiences a pressure due to the mass above it ie further to the left, not due to the mass to its right.
The further left we go the greater this discrepancy.
I thought that somewhere in this thread a small cavity was mooted at the C of G. A point mass in such a cavity will experience no pressure, since there is no contact with another mass.
It will however experience a balance of holding force as previously discussed.