I'm learning too. But here is my two cents. Vectors are abstract entities over a field (i.e. real numbers) and that satisfy certain axioms likely to be mentioned in your book. There is nothing different between a list of 4 numbers arranged in 1 row of 4 columns as opposed to a list of 4 numbers arranged in 2 rows of 2 columns when considered as vectors within a vector space. They obey the axioms. Furthermore, there is a 1-1 and onto mapping between the two by mapping the linear list into 2 rows, 2 columns. You still need ((1,0),(0,0))((0,1),(0,0))((0,0),(1,0))((0,0),(0,1)) to span the space as you would in a space spanned by vectors of the forms (1,0,0,0)(0,1,0,0)(0,0,1,0)(0,0,0,1). That is why your space is 4 dimensional.
I think you may be hung up on the visual representation of a vector as a list of number when that is just the most natural way to represent it for us to grasp it intuitively and most common applications of vector spaces are of that nature since it is usually real numbers that we are interested rather than exotic entities (unless I suppose you are into mathematics more advanced than I'm familiar with).