Excited states are only approximately stationary. The ground state is the only truly stationary state.
arunma, well this depends on what kind of level of detail that you want.
The most hand-waving would just be to point out that an electron is charged, a photon has an electrical field, and should thus be able to transfer energy to the electron, and so if the photon matches the energy and selection rules, you should be able to have a transition.
Somewhat less hand-waving, covered in most ordinary QM textbooks, is to treat your photon as a time-dependent oscillatory perturbation, do a little work, and out comes Fermi's Golden Rule as your transition probabilities, as a first order approximation. Now if you're talking spontaneous emissions, then your perturbation comes from a vacuum fluctuation/virtual photon, which is described by QED, and I'm pretty sure is covered in most QED textbooks.
The first thing you need to know when someone asks a 'why' questions is what level they want the answer to be on!