ZealScience said:
Though I've learned gauge transformation for a while, I can't figure out why it is significance in describing fields? For example, why electromagnetic tensor has to be gauge invariant? What does it physically mean?
My 2 cents:
Think about a photon. You want to describe it with something which is Lorentz invariant, right? A scalar won't do. The next simplest possibility is a vector.
But a vector in 4 dimensions contains 4 degrees of freedom (DOF's). But we measure that light has only 2 polarization directions. One DOF can be eliminated by imposing equations of motion (EOM). So we have one extra DOF left, which we don't measure. It is "eliminated" by stating that the vector has a redundant DOF which is not physical.
These redundant DOF's mean there should be something like an extra "symmetry". Between quotes, because we introduced it basically by hand by demanding that the photon is described by a Lorentz vector. This "symmetry" we call a gauge symmetry. For the photon this redundant DOF can be described by a phase, or the group called U(1).
This idea seems to be (why? we don't know!) a very fruitfull way to describe other fundamental interactions, like the weak and strong interactions, and in some degree gravity. This involves other groups like SU(N).
The idea, inspired by the electromagnetic case, is to observe that a free theory of matter has a global symmetry (at every event the same). Promoting this global symmetry to be local (changing from event to event) demands that you introduce fields to correct for the extra terms. These fields are interpreted as the fields propagating the fundamental forces, and describe the coupling of matter to these fields.
So: promoting a global symmetry of your theory enables you to describe the interaction (which depends on the symmetry!) of matter.
Apparently Nature likes symmetries, and thus gauge theories. But again, we don't know why :)