"... the diagonal one would not be diagonal any more with that change of basis, right?"
Interesting question raised here.
As you may know: Say that for some vector space V with dim(V) = n has a specified basis
A = {a
1, ..., a
n}. And suppose we have a linear transformation
L: V → V
that is represented by a square n x n matrix M acting on column vectors placed to its right. So that the kth column of M, which is the transpose of (m
k1, ..., m
kn), represents the vector
L(ak) = mk1 a1 + ... + mkn an
(Note that it is necessary to specify these things before we can make sense of questions about matrices, linear transformations, and change-of-basis matrices.)
Now suppose B = {b
1, ..., b
n} is another basis for V, and that we would now like to re-express the same linear transformation L in terms of this new basis.
Question 1: How do we do this?
Answer: First we need to write each basis vector of the new basis B as a linear combination of the basis vectors of the old basis A. There is always some way to do this. That will give n linear coefficients of the A vectors for each one of the n B vectors, and these need to be arranged in a matrix: Call it C
AB. (Sub-question: Exactly how should these n
2 numbers be arranged?) Now assume C
AB-1 is the inverse of the matrix C
AB.
Then with respect to the new basis B, the linear transformation L can be expressed as the product of the three matrices:
CAB-1 M CAB
in that order. Now — if the matrix C
AB is arranged correctly, we can apply this matrix to a column vector denoting an element v of V expressed with respect to the new basis B, and the result will be the column vector L(v) that is also expressed in terms of the new basis B.
Question 2: Suppose D is any diagonal n x n matrix such that there exists
some n x n invertible matrix C with the property that
C-1 D C
is
not diagonal. What can be said about the matrix D ?
(Perhaps it's easier to think of the complementary question: Suppose D has the complementary property that for
every invertible n x n matrix C, we have that
C-1 D C
is again a diagonal matrix. For which diagonal matrices D is this true for?)