I personally find matrices to be quite daunting. For example, the complex numbers can be represented by matrices and the quarternions can be represented by matrices. So matrices seem to be quite powerful and general.
And... a vector is a matrix as well. And surely any rectangular subset of a matrix is a matrix, even a single cell. So matrices are these amorphous things and we need to reign them in somehow.
And linear algebra would seem to be about matrices and matrix operations. For example, we have the equation |A - λI| = 0 which is an algebraic equation. So there definitely is an algebraic point of view. And I actually like this, that an eigenvalue is a solution to that formula.
As the OP is a math major, I want to recommend a book with this point of view but that will also be challenging (I always think a book should be challenging.) I therefore recommend
https://www.amazon.com/dp/B00CWR4Y9M/?tag=pfamazon01-20 as it seems to have this algebraic approach.