There is a distinction between a geometric vector space, in which the vectors are arrows emanating from an origin point, and in which addition is done by the parallelogram law, as opposed to an algebraic vector space in which the "vectors" are merely elements of some algebraic set in which it is possible to add two vectors, and also to multiply a vector by a number. In fact the algebraic elements can always be taken to be real valued functions.
Given a geometric vector space, (which most people can only imagine visually in one or two, or three dimensions), one can make it into an algebraic vector space by choosing an axis system, or "basis" as follows: just choose, in three space say, an ordered set of three non zero vectors, all in different directions, i.e. no one is in the plane spanned by the other two.
Use these three vector to set up a three dimensional axis system, so that every vector has its foot at the origina, and its head at some point having three coordinates (x,y,z).
Then we replace the arrow from the origin to the point with coordinates (x,y,z), simply the three coordinates themjselves. I.e. we say that, algebraically speaking, the triple of numbers (x,y,z), is the vector. In this way, the geometry is gone and we are calling as "vectors" simply all ordered triples of real numbers (x,y,z).
Then we just add these component by component and multiply by numbers in a similar way.
Now once we have done this there is nothing to stop us from saying that an ordered 4 tuple of real numbers is a 4 dimensional vector, added and multiplied in the same way. How to think of it geometrically is another problem, which we actually never need to deal with, although it is fun to try.
Then why not make a jump and call all sequences of real numbers vectors too. We can add then term by term, and multiply each term by the same scalar. Remember too that a sequence is also interpreted as a function from the positive integers to the reals. Just as the previous example was a 4 diemensional vector space, this is an infinite dimensional vector space. I.e. the dimension of the space is the number of coordinates of each vector.
Then one could just say that any real valued function on any domain space is a "vector" since one can add functions and also multiply a function by a scalar. So algebraically a vector space is just the set of all real valued functions on any domain set. The dimension is then the number of points in the domain set, not the number of functions on that set.
Abstractly, one can also call a vector space any set of objects that can be added and multiplied by scalars, subject to all the usual laws, but it can be proved that by choosing a basis, all such vector spaces are equivalent to spaces of functions.
The interesting invariant associated to a vector space is not the number of points in it, i.e. not the number of vectors, but the number that are "independent".
I.e. a set of vector is independent if none of them equals a sum of multiples of the others. Then the maximal number of independent ones is called the "dimension", which you see has no geometric dependency at all, and is defined purely algebraically. Wonderful to say however, it exactly coincides with the usual geometrical concept of dimension for sopaces of dieension 1, 2 and 3. It also coincides with the number of points of the domain set in the representation as a function space on a set.
After some practice, one can begin to imagine a family of three dimensional subspaces sliding along a 4th axis in 4 space, or even higher, say a 5 dimensional subspace of a 7 dimensional space. Maybe even an infinite number of mutually perpendicular vectors sticking out of the same point, all in very different directions. Why not?