There are two reasons changing an orbit by applying a force along the radial is not perferable.
The first is that it is less efficient.
For example if you want to reach escape velocity from an orbital velocity you need to increase the magnitude of your velocity by a factor of [itex]\sqrt{2}[/itex].
If you apply this velocity change in the direction of motion you only have to add about 41% of your present velocity to your present velocity.
Now what if you add your velocity along the radial? The additional velocity is added at an right angle to the orbital velocity so the magnitude of you final velocity will be gotten by [itex]V_f = \sqrt{V_o^2+V_r^2}[/itex]. It turns out that you would have make an velocity change equal to your 100% of orbital speed to get the desired 41% increase in the final velocity you need.
Thus it is more efficient to apply the velocity change along the line of motion.
The same is true if you just want to change an orbit.
The total energy of an orbiting object is given By [itex]E = \frac{mv^2}{2}-\frac{GMm}{R}[/itex] where R is the current radial distance of the object.
it can also be given by [itex]E = -\frac{GMm}{2A}[/itex], where A is the semimajor axis of the orbit (average radial distance for an elliptical orbit). For a circular orbit R always equals A, for an elliptical orbit R doesn't. Since the total energy of the orbit never changes we can say that for any orbit.
[tex]-\frac{GMm}{2A}=\frac{mv^2}{2}-\frac{GMm}{R}[/tex]
or
[tex]\frac{GMm}{2A}=\frac{GMm}{R}-\frac{mv^2}{2}[/tex]
note that as we increase v, the right side of the equation decreases, and the A on the left must increase to keep the sides balanced.
The upshot is that an that the average radial distance increases with an increase with the magnitude of the velocity.
But, as before, you get the most increase in velocity magnitude when you apply this velocity along the direction of movement.
Also, when you apply the velocity change along the radial you make ither orbital changes that might not be desirable.
If you apply a velocity increase to a circular orbit along the line of motion you create an new elliptical orbit with a perigee equal to the present orbital height and a new higher apogee.
If you apply the velocity change along the radial, you increase the apogee, but at the same time create a new lower perigee. The new orbit will swing in closer to the planet than the orginal orbit. If you are in low Earth orbit to start with, you are about as close as you want to get already; any lower and you'll start to dip into the atmosphere.