First think about a CR cicruit (replace your inductor by a resistor).
Suppose there is a switch in the circuit, so you can start with the capacitor fully charged and then close the switch.
When you close the switch the current instantly rises to at its maximum value, and decays to zero as the voltage across the capacitor reduces.
Now, think about the LC circut, again starting with the capacitor fully charged and closing the switch.
This time, the current can not "instantly" rise to its maximum value, because the back EMF generated in the inductor opposes it (Lenz's law). The back EMF depends on the rate of change of the current, not the magnitude of the current.
So, the current starts to increase gradually, and as the voltage across the capacitor decreases the rate of increase slows down because it takes less back EMF to oppose the incease.
Eventially, voltage across the capacitor has reduced to zero but the current has built up to its maximum value. At this point, all the energy in the circuit is stored in the magetic field of the inductor.
The current then decays back to zero, which produces a "back EMF" of the opposite sign in the inductor. When the current reaches 0, the voltage across the capacitor is equal to the starting voltage, but with the opposite sign.
The process then repeats with the currents and voltages reversed, to complete one cycle of the oscillation.
Hope that helps understand what it going on in a "non-mathematica" way.