Voltage is a difference in electric potential. Electric potential is the electric potential energy a point charge would have at that location in space. Two points at the same electric potential have no voltage between them and electric charges at these points would experience no force.
Consider a negative test charge located halfway between a positive and negative electrode. The test charge will be repelled by the negative electrode and attracted by the positive electrode. This means that it has potential energy and will experience a force that accelerates it, performing work on it and transforming the potential energy into kinetic energy. In other words, there is a difference in electric potential between the point where the test charge is at, and a point closer to or further away from either of the electrodes. Closer to the positive electrode, a test charge will not have as much potential energy since it can't accelerate for very long before colliding with the electrode. When placed near the negative electrode, a test charge will have a much greater distance to accelerate and will reach a much higher velocity before colliding with the positive electrode and thus has a greater amount of potential energy. The amount of potential energy the test charge has is known as electric potential, and the difference between the electric potential between two points is known as the voltage. (Electric potential is actually a little more complicated, but for this example all you need to know is that it is a measure of potential energy. I'm mentioning this because I want you to know there is a reason "electric potential" is being used instead of just going with "electric potential energy")
If the electrodes have a higher negative and positive charge, then our test charge will experience a greater force, meaning that it has more potential energy than when the electrodes were at a lower charge. It will be accelerated faster than before, reach a higher velocity, and have more kinetic energy when it impacts the positive electrode. As you can see, this greater force results in more potential energy, which then results in a greater electric potential (electric potential energy) and a greater difference in electric potential between two points, aka voltage.
If we take these concepts and apply them to a circuit, we see that a higher voltage causes the charges to have more energy. Since we are constantly applying a force to the charges, the charges are constantly being accelerated. The difference lies in the fact that charges in a conductor aren't able to simply accelerate to any arbitrary speed. They constantly interact with ions and other electrons and transfer some of their energy through collisions, magnetic forces, etc. In other words, applying a voltage performs work on the charges, which in turn perform work on the circuit as a whole by heating it up and interacting with the load.
A higher voltage, aka a greater difference in electric potential, means that the force applied to the charges is greater and thus more work is performed on the charges themselves and by the charges on the circuit. The amount of work performed can be found by multiplying the voltage by the current, since the current is the number of charges and the voltage is the force applied to them.
Think back to our test charge example. If we double the voltage then the force on the test charge is twice what it was before. Twice the force means twice the work performed on the charge (Since work = force x displacement). But remember that power is work over time. Our test charge, experiencing twice the force, undergoes twice the acceleration, meaning that it takes less time to reach the positive electrode. Since we did more work AND took less time, the power isn't simply twice what it was before, it's actually four times what it was before.
So if we take a circuit with a set resistance, then doubling the voltage doubles the current and the total power quadruples.
Make sense?