That is drastically wrong.If according to Dadface's interpretation, the battery is an electron pump, then it must have energy to pump the electrons which comes from the work done in keeping the electrons separated from positively charged atoms in a battery.The atoms and electons are separated by a partition inside the battery, so the electrons can only take the long way out by substituting conduction electrons in the wire and repelling them to the positive end of the battery.
In the case of a DC source applied to a capacitor the circuit is broken and we say electons are deposited on the plate of the capacitor but there is no current in the circuit.You cannot think something like when the battery is removed the electrons are withdrawn by the battery because even at this point, the battery is more unstable than the wire.