Galaxies are, on average, moving further away from one another at a rate proportional to their distance. That statement is what is meant by, "Space is expanding." The two descriptions are one and the same.
Edit:
One way to think of it is by looking at the Einstein Field Equations which describe General Relativity. They can be written as:
$$G_{\mu\nu} = {8\pi G \over c^4}T_{\mu\nu}$$
I'm sure this looks like a bunch of incomprehensible characters, but the basic premise is simple: on the left is what is known as the "Einstein tensor" which describes space-time. When people say, "space is expanding," they are talking about the behavior of the Einstein tensor.
On the right hand side is what is known as the "stress-energy tensor". This object describes the matter content of the universe. When people say, "galaxies are moving away from one another," they're describing the behavior of the stress-energy tensor.
The two terms are equal, so they're just different ways of looking at the exact same thing.