Asking what an electric field, or any physical concept, really is gets you into difficult territory, and besides, it's not really part of physics. At its core, physics only explains observations; it doesn't deal with the mechanisms behind those explanations (although sometimes we speculate about the mechanisms when it makes the science easier to understand). In other words, physics will tell you how things behave, but it won't tell you anything about their underlying nature that isn't reflected in their behavior. In fact, as far as a physicist is concerned, once you know how something behaves, you know all there is to know about what it is; anything further is just idle speculation. (Which can be fun, don't get me wrong, but it's not really science) And we do have a mathematical model for how the electric field behaves, so as far as physics is concerned, that's what it is - it's a value at every point in space that specifies what the force on a unit test charge at that point would be.
I think I even confused myself writing (and rewriting) that... this is why I stick to the math ;-)