The difference is that in a conductor you also have electrons which DON'T move around because they are not valence electrons.
Hello Drakkith, it is sometimes really difficult to avoid giving the wrong impression when making general statements at a more elementary level.
All electrons in a normal substance are originally 'valence' electrons.
If there were additional non valence electrons the substance would not be electrically neutral!
The truth is very complicated but essentially it works like this.
When neutral atoms join together to form solids their individual electron orbitals also join up to form what are effectively giant orbitals that encompass the whole solid,
We call these bands.
Each band incorporates many quantum levels, (there must be many because there are many electrons to be accommodate in a mass solid and you can only have one electron per 'slot').
Just like in isolated atoms the levels vary in energy and have gaps between in an energy diagram.
I have shown this diagrammatically in Fig1
In both the isolated atom and the multi-atom band we electrons naturally start at the bottom of our diagram and work up until there are enough to balance the positive charges of the nuclei that are present.
Additional thermal energy or energy from an electric field allows electrons to jump up to higher levels as already described.
This is not a question of spatial distribution ie distance form the nucleus both Figs 1 and 2 are energy level diagrams.
The lowest (=least energy) band is usually filled or nearly filled and called the valence band because the electrons here are tied to their positions.
The next band is usually empty, apart from the thermally promoted electrons which jump up and fall back in dynamic equilibrium. This band is called the conduction band, because the electrons here have the mobility to move about and transfer charge, as previously described.
It is the different structure of these bands and gaps that determines whether a substance is a conductor, a semiconductor or an insulator.
In a conductor the conduction band is close to or touching the valence band so electron exchange from one to the other costs little energy and is easy and frequent.
In semi-conductors and insulators the bands are separated by a gap which reduces the exchange as the gap increases.
I have shown this diagramatically in Fig2
Go well