Well, consider what happens under a unitary transformation when dealing with finite matrices. Say you have unitary matrix U, and you are transforming matrix H. U^-1 HU is the unitary transformation. Recall a unitary matrix is composed of orthonormal columns. This means its adjoint is its inverse (assuming a square matrix). So, HU gives the matrix H acting on each column of U. So if we call the columns |a_n>, then since they are also the eigenvectors of U, U=|u_n><u_n| as n runs through all the columns (this summation will be implied from now on). Notice U is just a projection operator. And U^-1=|u_n*><u_n*| where * denotes the complex conjugate. Now, let's represent H with its eigenvectors |H_k>, and eigenvalues E_k: H=|H_k>E_k<H_k|. So, you can see that U^-1HU is simply equal to |P_k*>E_k<P_k| where |P_k> denotes the projection of |H_k> onto U space. U^-1HU is clearly (and by definition) isomorphic to H. So in conclusion, what you are doing is representing H in terms of the space represented by U.
Recall that if H commutes with U U^-1 HU=H (proved by multiplying both sides by U), H is invariant. That's where the symmetry stuff comes from. Go ahead an play around with the this (like sharing eigenstuff when H and U commute-stuff like that). You should right away see the mathematical origins of much of the quantum physics theorems.
Good question! It has lots of interesting answers!