But after the first shell, why are the other shells also quantized? I mean why can't the electron in its ground state gain a teensy amount of energy and reach the next consecutive shell (not the quantized one) ?...
What type of imbalance prevents electrons from staying in space between quantized shells?
This is a tough question to answer here. In classical theory (pre-quantum theory), we assumed that energy transfers occurred continuously; we could transfer any amount of energy in an interaction, and an exact amount. If we knew from experiment that we could transfer a specific amount of energy by colliding two particles, we assumed that we could tranfer any fraction of that energy, which is how energy transfers appear to work in macroscopic physics. But major theoretical problems arose with any theory that allowed continuous transfer of energy--like the predicted "ultraviolet catastrophe" that was never observed in experiment. And even when continuous models demonstrated some success in experimentation, other phenomena remained unexplainable, like the photoelectric effect, and what was observed in the dual-slit experiment. I'd love to explain these to you, but I could write a book about them before I got to my actual point. These are the problems and experiments that lead to quantum theory in the first place, and any good textbook will explain them. I suggest David Bohm's
Quantum Theory, this is all in the first 2 chapters. But to put it plainly, particle physics works only if we assume that a particle has to transfer energy in discrete, discontinuous "jumps".
Electron wave functions can and do take a value between orbitals, but there are only a few specific possible energy values the electron can have while it orbits the nucleus
As far as I know (and I don't know much ), an electron always behaves as a particle.
Unfortunately, this isn't the case, and this is where the first part of your post gets off track. Actually, it seems like you have a very good grasp of an atomic model that assumes that the electron is always a particle like a billiard ball, and it's good that you can feel out this model. But we know from experiment that electrons act as waves; they can exhibit an interference pattern (this goes back to the dual slit experiment).
At first, it seems natural enough to think of an electron wave as nothing but the probability function of finding the electron particle at a certain time. It even spreads out with the momentum of the particle. But if we try to develop this hypothesis, that the wave function is just the spreading probability of finding the ball or point-like particle, it doesn't work out. Again, I'll need to refer you to read up on the dual-slit experiment (especially the variant in which it's performed with a single electron at a time, many times).
So is the real reason this: that if we are forcing an electron to follow a definite path to a proton, we are applying a force on it, which increases its energy. The attraction of a proton should be greater than this energy for the electron to be present into the nucleus. But it isn't. So an electron in a nucleus has huge energy and the proton does not possesses enough attractive energy to keep the electron in that state. The electron inside the nucleus is in a highly unstable state, as now its location can be predicted with high accuracy, which increases its momentum/energy. Therefore it tries to break free of the nucleus. The ground state of the electron of a hydrogen atom is actually that state in which the energy of the electron and the attraction of the hydrogen nucleus balance each other. Am I right?
Eh, pretty close. The electron breaks free from the nucleus, because we can only find it in the nucleus when it has a ton more energy than the energy of the charge force--so it's already traveling away from the nucleus pretty fast (or will be shortly). The charge force alone won't bind an electron to the nucleus, we have to apply an external pressure.
An electron wave naturally "wants" to spread out unless a force is applied to the wave front. If the electron were to lose all momentum, it's wave function would be compressed to an exact location in space, indefinitely. But an electron with no momentum wouldn't have enough energy to hold itself as a point-like particle in a definite location for long, so we find that, paradoxically, having an electron with less momentum requires more energy than an electron with a minimum of momentum. The problem is in thinking of the electron as the billiard ball, which would always have positive potential energy proportional to its distance from the nucleus.
Also, the charge force and the "centrifugal" force due to the orbit of the electron are balanced at every excitation state, not just the ground state. I guess we can say that the ground state is special, because if the electron were to fall any further into the nucleus from here, there wouldn't be enough charge force to hold the electron in so small a space for long. The more you compress the electron wave, the "denser" it gets, so it becomes increasingly resistant to squeezing.