Radioactive decay is governed by the exponential law $$N(t)=N_0e^{-\lambda t}$$ where N_0 denotes the number of nuclei at t=0 , and \lambda is the decay constant which is different for different nuclei. If you use the word "probability of radioactive decay" for "rate of radioactive decay" it is not same for all nuclei. In case of radioactive decay too, the decay rate \frac{dN}{dt} also varies with time in a nonlinear fashion.
In presence of the environment, the eigenstates of the atomic Hamiltonian are not true eigenstates of nature. Therefore, each atomic level has a certain lifetime \tau which depends upon the interaction it is subjected to. In general, a single atom continues to make transitions between the atomic energy levels.