I am astounded by number of bad advice on this topic!
First of all, power supply IS one of the most important things you need to have on your test bench.
1)If you are testing something, you need power to be available at an instant. You don't want to go trough box of old wall warts!
2) You must be able to see, adjust, or limit voltage and current your circuit can take. Otherwise you might fry whatever you are working on. Especially if you are measuring, you might short something with the probe of your multimeter or oscilloscope. Micro controllers and transistors die like flies.
3) Using wall warts as a power supply is really not a good idea, if you are beginner you might injure yourself or die.
If you overload the secondary of that 5-10W transformer, you might heat it up and cause short circuit between primary and secondary! Do not do that. Most of those wall warts are cheap Made In China devices, that probably can't survive maximum load written on them, wire is way to thin, and insulation cracks if you touch it.
4) Don't buy kit's. If you really want to learn electronics, you need some tools.
You will give, 30-40 dollars here, 20 dollars there, and in the end you will have bunch of crap that you can't use for anything, that is way more dangerous, without any displays to tell you what you are doing, and for the same money you could have bought yourself a nice bench supply that will serve you for the rest of your life.
5) saying power supply is less important then oscilloscope is really strange. You can't do much testing without both, but one is not more important than the other.
IF you can't afford some brand name power supply, or you still don't know what you need, you should go and check ebay. Just type "lab power supply" or "bench power supply" and you will find plethora of 50-60$ linear power supplies that can give you 0-30V with max 3-5Amps, just make sure they have current limiting function.
You might find some nice used ones as well. Even those unknown ones will serve you for many years, it's not like you need them to be on 16 hours every day...
Get two of those, and you will be able to test most of the circuits you find online.