Well, as long as we are not being philosophers, we can make space simple.
The only parts of space we are interested in in the context of science is what we actually measure with a ruler - or some more portable equivalent, like a radar set and a clock.
If you put on a philosophers hat, I'm sure you can waste - errr, I mean spend - a lot of time, as much time as you like (once you've decided what time is, of course - or perhaps not, perhaps you'll spend the time without knowing ever knowing what time is) talking about it.
Preferably in the philosophy forum, where you'll find likeminded people :-)
But all we need to know about space to do science, including GR, is how to measure distances with a ruler (or a radar set).
And all we need to do to define how space curves is to take a bunch of measurements with our rulers (like we did with the hypothetical rowboat).
It Really Is That Simple. You don't need to do anything else but be able to measure distances with a ruler in order to define and measure curvature.
Furthermore, once you have a standard ruler (like the SI ruler), it's an empirical question (and not a philosophical one) as to whether or not space is curved or flat. You go out, and do the measurements, and analyze them and report back.
Like the rowboat case, you need to measure the distances between a bunch of events in space-time (or nails, in the case of the rowboat) in order to come up with some idea of whether or not it's curved or not. Putting in two nails and mesuring the distance between them won't tell you anything about curvature, for instance.
For starters, it might be productive to imagine that you are a flatlander,
http://en.wikipedia.org/wiki/Flatland, living on the curved surface of a sphere, trying to figure out the geometry of said surface.
You'll see that as a flatlander, you'll need to measure the distances between at least four points to be able to measure curvature, a total of six measurements. Three points and three measurements won't tell you anything about curvature, you can always draw a triangle on any curved surface.
If you arrange your four points so they determine a square, whether or not the diagonal is sqrt(2) times the sides will give you a Big Clue as to whether or not you, as a flatlander, are living on a flat surface or a curved one.