The Arduino uses C but modified to handle the many input/output functions.
The home page of Arduino is this one:
http://www.arduino.cc/
Or, you can buy them here:
http://www.sparkfun.com/search/results?term=arduino&what=products
They are not cheap, though.
Picaxe chips come in various sizes but all (except the optional surface mount ones) have the standard 0.1 inch pin spacing. So, you can solder them into circuits or put them in sockets and program them with a simple interface to your computer which only involves 2 resistors and an old mouse cable.
The language is very simple and there is on-screen help and debugging for getting syntax right. It is like Basic, but most of what anyone does involves the I/O pins, so the actual language doesn't matter much.
Arithmetic is Integer, meaning no floating point.
These are also available as above:
http://www.rev-ed.co.uk/picaxe/
http://www.sparkfun.com/search/results?term=picaxe&what=products
http://www.phanderson.com/picaxe/
As you can see, the chips themselves are quite cheap and elaborate boards are nice but not necessary. You could get started for under $10.
If you want to get results quickly, one of these systems would be worth considering. For example, to get a delay of 1 second (1000 mS) with the Arduino, the command is
delay (1000)
With a Picaxe, it is
pause (1000)
In assembler, it involves much shuffling of registers and accumulators just to get a simple delay which you would use to flash a LED on or off, for example.