Sorry for the delay. rude man and I were having a side discussion. It bothers me that the hole might not be sufficiently small to ignore bulk flow (Bernoulli style) and just treat it as pure diffusion. However, it looks like that is what is expected here.
I started by checking my ideas by deriving the given equation from first principles. Consider a gas of atoms mass m between two parallel plates area A a small distance h apart. Consider one moving at speed v at an angle theta to the normal to the plates.
The probability density of such an angle is sin(theta).
The momentum change normal to the plate on striking it is 2 mv cos(theta).
The frequency with which the atom strikes the same plate is v cos(theta)/2h.
The total number of atoms is ##\rho Ah/m##.
Putting all this together, the force on a plate is ##\int _0^{\pi/2}\rho \frac{Ah}m\frac{v\cos(\theta)}{2h}\sin(\theta)2mv\cos(\theta).d\theta = \frac 13\rho Av^2##.
Since c is the rms speed, the pressure is ##\frac 13\rho c^2##.
So far so good.
The escape rate through a hole area A would be the rate at which atoms would strike that area. This is the same integral as above, but leaving out the factor for momentum change per atom strike.
By this method, I get a mass loss rate of ##\frac 18\rho Av##.
But this is awkward since the average v is not c. So we need to plug in the distribution of speeds in an ideal gas.
@rude man , do you see any flaw in that?