Here is a simple, quick, and cheap (no aircraft carriers needed) experiment:
Obtain two stackable drinking glasses, like those used at fast food restaurants. Fill one with water. Set the other, empty glass, in the water. The second glass, being empty (and light) will displace a small amount...