I would think of it in terms of [tex]Z = \frac{dv}{di}[/tex] (although there may be other ways).
For a good voltage source, the output voltage is very stiff (doesn't change much) as the output current changes, so
[tex]Z = \frac{dv}{di} = \frac{0}{di} = 0[/tex]
But for a good current source, you get very little change in the output current over a wide range of output voltages, so
[tex]Z = \frac{dv}{di} = \frac{dv}{0} = infinity[/tex]
EDIT -- okay, I give up. How do you make the little infinity symbol in LaTex? "\inf" didn't work.