I would phrase that differently. A matrix can be used to represent a tensor, in the same sense that a list of numbers represents a vector- but they are not "the same thing", even basically.
sainistar, if your given matrix is a function of a vector, then you can certainly differentiate.