The energy and angular momentum operators have discrete spectra when applied to the system of a hydrogen atom. And angular momentum being momentum * radius means that the radius is quantised.
To understand why the operators are quantised, you have to go all the way back to how we choose quantum operators, and that's down to satisfying the classical correspondence limit (in the limit as masses and momentums become large, results predicted by QM tends to results predicted by classical mechanics) as well as satisfying the canonical quantum mechanical relations (pq - qp = -ih etc).
To understand what these operators work on, you should be familiar with the Hilbert space. You should also understand Schrödinger's equation - that's what we use to derive radii levels.