What an interesting thread -- it's so hard to translate from brain to symbols and back again. I'll take a whack at it, mostly for my own edification. I am not a physicist; barely an EE on a good day.
If you hung a mass from a spring on the ceiling, pulled it down until the spring was fully extended, you wouldn't be surprised to see that the mass not only flies up until the spring is completely compressed, but then reverses direction and continues to oscillate. My theory is that you're asking for the same physical intuition about the LC circuit and how it reverses direction, for which we are not born with any natural intuition. Not being that smart, I try to think about things in the simplest possible terms, preferably basic DC if no calculus is really required.
If I hook a battery up to a capacitor, it initially looks like a short circuit. All the electrons go a runnin' towards one plate, but they can't cross the barrier, so a voltage (measured across the capacitor) starts to zoom upwards and the electrons start going slower and slower as the capacitor voltage gets closer and closer to being equal to that of the battery itself. Finally, the capacitor looks like an open circuit to the battery, or like a battery that has the same voltage as the battery that charged it. If I then short the terminals of the capacitor, it will send a current running in the reverse direction, first a whole lot of current, then less and less as the capacitor's voltage decreases because it is using up its electrons.
If I hook a battery up to a coil, it initially looks like a open circuit, 'cause the moving electrons are trying to cause a magnetic field to build up. As the field gets closer to its maximum value (associated with whatever current the battery is capable of supplying), less work is being done to increase it and the current goes faster, until eventually the coil looks like a short circuit, current is flowing as fast as the battery can supply it. Of course, if I then try to unhook the battery, the current that was supporting that magnetic field stops and the field starts collapsing, inducing a current in the reverse direction (and a big ol' spark that made many a child of the 50's think that electronics might be cool to learn).
So both the capacitor and the coil are capable of storing energy via electrons running in one direction, then releasing energy by causing electrons to run in the opposite direction. We've got the basic ingredients for oscillation.
You're proposing to charge a capacitor up to some voltage, then hook a coil to it. So at the beginning, the capacitor looks like a battery, the coil looks like an open circuit. Electrons start to flow slowly, the mag field of the coil starts to build, the voltage across the capacitor starts to drop slowly as its plate loses electrons. Electrons flow faster, because the coil is starting to look more like a short circuit, the mag field is building, and the voltage across the capacitor is dropping faster. Eventually, things reach their peak. The rising current from the capacitor can rise no more, the mag field can build no more, and when the current starts to decrease (as it must because the capacitor voltage keeps dropping), that means the mag field starts to collapse. That's where the first reversal comes in. The collapsing field supplies a reversal, and soon the electrons are flowing in the opposite direction, charging the capacitor with the opposite polarity that you originally charged it with. One half of the oscillation is complete and things are back roughly the starting point except the capacitor has an opposite charge, so it can supply its next reversal. Of course, the process symmetrically reverses itself, supplying the other half of the oscillation, putting things roughly back where it all started.
Just as the spring and mass oscillate by sloshing energy back and forth between two different storage mechanisms (the energy stored by elevating a mass, and the energy stored by extending a spring), the LC circuit also oscillates by sloshing energy back and forth between two different storage mechanisms: the voltage potential created by charging a capacitor, and the current potential created in a magnetic field by running a current through a coil.
Of course, real inductors and capacitors leak and contain resistances, the Second Law pertains, and things peter out over time rather than becoming a perpetual motion machine, but I imagine you were already clear about that.