All vectors are, technically, tensors. All tensors are not vectors.
This is to say, tensors are a more general object that a vector (strictly speaking though, mathematicians construct tensors through vectors).
Tensors are technically defined through two different objects:
1.) Vectors.
2.) One-forms. ("dual" vectors)
Vectors are just objects for which you know what it means to add any two of them (vector addition), and what it means to scale-change it (scalar multiplication). One-forms, likewise, have all the same notions, except that they can operate on vectors and return scalars.
Examples are in order: The most prototypical examples are Euclidean vectors --points of space. Examples of one-forms would be the magnetic potential "vector" (It's actually not a "true" vector) or the gradient operator.The most important property, when you add a few other suitable assumptions, is that one-forms and vectors transform in particular manners under a change of coordinates. These are the properties that physicists are most often concerned with when discussing things like the theory of general relativity.
Tensors, by extension, as mathematical objects are "multilinear" operators; this is to say, they take in sets of vectors (and/or one-forms) and return another tensor (as opposed to linear operators which take in vectors and return vectors). These have varying uses.If you want to understand the general theory of tensors, you should understand abstract algebra (especially linear algebra), and if you want to understand tensor calculus you should understand the theory of differentiable manifolds, also.