I would say a "gauge connection" is simply a connection on a principal fiber bundle, i.e. a Lie algebra-valued 1-form ##\omega## that maps fundamental vector fields to their generators, and transforms as ##R^\star_g\omega = ad(g^{-1})\omega## under the right-actions of the structure group (the "gauge group" in physicist's terminology). (But I'm not sure I heard the term "gauge connection" before, so maybe something else is meant?) A gauge potential is what you get if you pull ##\omega## back to the base space via a local section. In other words a gauge potential is defined on spacetime with respect to a local "choice of gauge". So, both are closely related, but different concepts.
Unfortunately it is difficult to explain all this without introducing a lot of jargon first. A book I like, that explains all this in quite simple terms is David Bleecker, "Gauge Theory and Variational Principles".