Light is absorbed when there is an excited state to go to.
You can picture a proton as the ground state of the (uud) 3-quarks system. The first excited state of this system (if it exists at all… I don't know…) is very high in energy and unreachable by photons with “reasonnable” energies