Radioactive decay is governed by the exponential law $$N(t)=N_0e^{-\lambda t}$$ where [itex]N_0[/itex] denotes the number of nuclei at [itex]t=0[/itex] , and [itex]\lambda[/itex] is the decay constant which is different for different nuclei. If you use the word "probability of radioactive decay" for "rate of radioactive decay" it is not same for all nuclei. In case of radioactive decay too, the decay rate [itex]\frac{dN}{dt}[/itex] also varies with time in a nonlinear fashion.
In presence of the environment, the eigenstates of the atomic Hamiltonian are not true eigenstates of nature. Therefore, each atomic level has a certain lifetime [itex]\tau[/itex] which depends upon the interaction it is subjected to. In general, a single atom continues to make transitions between the atomic energy levels.