In my opinion, linear algebra is about linear maps. the vector space are merely where they take place.
as to non linear algebra, to me that would be non commutative group theory, and "commutative algebra" (polynomial maps).
There is also a linear side to "commutative algebra". I.e. although polynomial maps are not linear, the ring of all polynomials is commutative and
can be profitably considered as the coefficient ring for a "module", i.e. a commutative group with an action by that ring. Then there are linear maps
of those modules for which the rings of polynomials behave as scalars do for vector space maps.
So for me, basic algebra comes in two flavors, linear algebra (possibly generalized to modules over arbitrary commutative rings), where the fundamental tool is essentially the Euclidean algorithm, and non commutative group theory, where the basic tool is the action of the group on various objects.
Matrices give rise to interesting examples of both theories, since matrices define linear maps, but groups of matrices, such as GL(n (invertible matrices)), SO(n) (e.g. rotations),define interesting non commutative groups which act on vector spaces and on subspaces, as well as on tensor spaces.
This point of view is spelled out in this introduction to course notes on my web page: (80006 is a typo for 8000)
http://alpha.math.uga.edu/~roy/80006a.pdfanother answer (maybe more appropriate to the original question) is that, for some purposes, the most important operators are operators on function spaces, and there you have both linear and non linear differential, integral (and other, as micromass illustrated) operators.