The fact there there is an inverse means that for each element x, there is an element y such that xy = 1 mod p - and this is only true because p is a prime (a well known group theory result). The main idea for the proof of this theorem is to try to pair up each element with it's inverse (which is valid since this group is commutative).