Pressure is an interesting topic. It is defined as a normal force force exerted by a fluid per unit area. If you were to draw a free body diagram for the object under consideration, you would have 4 normal forces perpendicular to your object (let's say a box). Thus, you would have an arrow going in on the left, bottom, right, and top, along with the weight of the object. You might know from physics that if an object exerts a force, that means there is an equal but opposite force also present. Pressure in a fluid increases with depth because more fluid "rests" on deeper layers, and the effect of this "extra weight" on a deeper layer is balanced by an increase in pressure. If you were calculating the pressure at a given point 10 meters below the surface of water, you would have to take P(atm) + [tex]\rho[/tex]gz, [tex]\rho[/tex] being the density of water, and taking g to be 9.81 m/s[tex]^{}2[/tex]. It's interesting to note that moving left and right in the water does not cause a pressure change.
I hope this helped answer your question a little bit!