After vol.1 Apostol, he should use vol.2 Apostol. In particular, multivariable differential calculus is conceptually much more natural using linear algebra, which Courant does not do.
By the way, here is a free, short (about 125 pages), book on linear algebra that I wrote for fun.
https://www.math.uga.edu/sites/default/files/laprimexp.pdf
It is an expansion of a much shorter version (15 pages) available on the same website, which I wrote just as an exercise to see how short I could make a book on linear algebra, leaving many easier facts as exercises.
By the way, the book by Richard Penney looks quite good, but there are many ways to present the subject, and even though his book is almost 500 pages, and covers many, many things mine does not, he still does not quite cover all the same bases. E.g. he presents the Jordan form of a matrix, but not the rational canonical form. One difference between them I like to point out, is that one cannot usually actually compute the Jordan form in practice, since it requires factoring the characteristic polynomial, and there is no practical way to factor polynomials. There is however an algorithm for computing the rational canonical form by hand, so one can actually find this form in practice. My little book covers both topics, and even proves the (less important) uniqueness of the reduced echelon form of a matrix, which Penney omits. I also at least sketch a more general form of the spectral theorem than he does, for "normal" operators. He also seems to omit any applications of linear algebra to differential equations, which my book includes. I think this is curious, although common, since differentiation is arguably the most important example of a linear operator. So it never hurts to have more than one book around.
Another glance at Penney reveals that he also treats numerical methods. In the computer age, this is another response to the fact that polynomials are hard to factor. i.e. since one cannot always compute
"eigenvalues" exactly by factoring, one can use numerical methods to at least compute them approximately. I do not treat this (out of ignorance).