It is not like "photons above a certain energy are absorbed because they have enough energy", it is more like when he was talking about light not going through a wall, I think. If the red light is energetic enough to excite some "easy" electrons up two levels, for example. But then maybe on the way back "down" they stop at the intermediate level (emitting an infrared level photon). Then they go back to ground state and maybe another infrared photon.
I am not sure if this is exactly how it works or not, but that is what I am thinking. It seems hard to find any information detailing "why" certain atoms (or crystal structures) absorb 1 "color" and not another, but just remember that if the electron is excited, it will eventually go back to ground state, emitting a photon, but not necessarily in the same direction.
Also, it is common to excite more than one level then go back down in intermediate levels. This is how a black light (high energy UV photons) makes certain materials appear to glow. We cannot see the UV rays, but we see the lower energy photons which are emitted by the intermediate stages.