I am not sure what you mean with an exception happening, but nitrogen with a -3 charge (regardless of whether it exists or not) has the largest radius. With that said, it's difficult to look at ionic radii as they are difficult to measure and the ionic radii varies with the co-ordination of the ion and which ions are surrounding it. As such there are some inconsistencies. The general trend for atomic radii (increases down a group, decreases across a period) and ionic radii (increases down a group, varies) can be explained if you look at the electronic structure of the atom/ion.
For trends in atomic/ionic radii down a group, the atoms get bigger because an extra layer of electrons is added. Compare the electric structure between nitrogen and phosphorus for example:
Nitrogen: 1s2, 2s2, 2p3
phosphorus: 1s2, 2s2, 2p6, 3s2, 3p3; phosphorus has an entire n=2 energy level over nitrogen providing electron shielding.
For trends in atomic radii across a period, the size of the atoms decreases. The number of protons in the nucleus increase across the period; the increased in # of protons increases nuclear attraction for the electrons, so the electrons are pulled in more tightly. The electron shielding is the same for the atoms across a period, so the only factor affecting atom size is the number of protons.
The trend for ionic radii across a period can be explained similarly. You just have to look at the positive and negative ions separately. The number of protons increases across the period. This tends to pull the electrons more towards the center of the atom, thus decreasing ionic radii. This is true for both negative and positive ions. However, the negative ions in the same period generally have an extra layer of electrons (so there is a big jump from, say, Al3+ to P3-, in ionic radii).
As for noble gases, you generally want to ignore those. As DrDru said, atomic radii refers to the average distance of ions in compounds, and noble gases like neon and argon don't form bonds, so their atomic radii is more difficult to measure (it's based on their van der Waals radius).