A reasonable analogy for understanding similar matrices?

In summary: A matrix is similar to its diagonal form if and only if the diagonal form represents the same linear transformation.
  • #1
kostoglotov
234
6
I don't really feel that I understand what it means for two matrices to be similar.

Of course, I understand the need to understand ideas on their own terms, and that in math analogies are very much frowned upon. In asking if you know of any "reasonable" analogies for what it means for two matrices to be similar, I'm also asking for a broader kind of informal help with the ideas of similar matrices, Jordan Forms and diagonalization.

My cousin (who has not studied LA beyond High School vectors and matrices, solving systems of equations, etc) recently asked me if similar matrices have the same angle between the vectors in the matrix, drawing an obvious analogy to geometry with similar triangles. I replied that similar matrices have the same set of eigenvalues (necessary but not sufficient) and must all share the same Jordan Form...of course, I don't really know what a Jordan Form is - I've seen the method for constructing them and I know that they are as near to a diagonalization as is possible for a given matrix that cannot be diagonalized; and that the diagonal form of a diagonalizable matrix is its Jordan Form.

Which brings me to what I do and don't understand (and suspect) about diagonalization.

A diagonalization is a change of basis to a full eigenvector basis for a matrix/transformation. So if you convert all your vectors of interest into that same eigenbasis, then you can just multiple that vector by the diagonal lambda matrix, which is much more computationally efficient and analytically insightful than doing the transformation in some other basis -- as the former merely involves a simple scaling of the basis vectors to achieve the same transformation.

So I went into MATLAB's eigshow(), and went to compare a matrix to it's diagonal form

[tex]\frac{1}{4}\begin{bmatrix}1 & 3\\ 4 & 2\end{bmatrix} \ \text{versus} \ \begin{bmatrix}-0.5 & 0\\ 0 & 1.25\end{bmatrix}[/tex]

And it definitely seems that both those similar matrices are performing the same transformation, just in a different basis.

RXBDmJl.jpg


So, a diagonal form is doing the same transformation, but in a different (more manageable) basis...?

Is the Jordan Form of a matrix doing the same transformation just in a different basis?

Is there a connection between Jordan Form and SVD?
 
Physics news on Phys.org
  • #2
"Is the Jordan Form of a matrix doing the same transformation just in a different basis? "

yes, that's what similar means in general. i am assuming by "A is similar to C" you mean that C has form B^-1AB for some invertible B. Angles however are usually not preserved, since the basis does not have to be mutually orthogonal. For certain matrices, e.g. symmetric ones I believe, you can actually find an orthonormal basis that diagonalizes it.

So for linear maps or matrices that can be orthogonally diagonalized, it just means you grab hold of the axis system in space and rotate it around (without changing angles between axes) into a new position and in that position your map just stretches along the axes.

Or said backwards, you just look for those lines along which your map merely stretches things, those are guaranteed to be orthogonal (in good cases), and you choose them as your new axes.

So in general finding all matrices similar to yours just means looking at the matrices of your map in all possible bases. The theorem on jordan form says that if the characteristic polynomial splits into linear factors in your chosen field, which can always be achieved in some finite extension field, then the matrix is similar to exactly one jordan matrix, except for permuting the order of the blocks, or deciding whether your jordan matrices should be "upper or lower diagonal".

I have written several free sets of course notes on this, in math 845, 4050, 8000, on my webpage, the most detailed being math 845:

http://alpha.math.uga.edu/~roy/

The 845 notes are a bit abstract, using the notion of modules, but the fact you deduced is stated on page 47 of the 845-1 notes. The 4050 notes were aimed more at undergrads and tried to avoid the concept of modules, (a generalization of vector spaces where the scalars come from just a ring, which I take to be commutative, but not necessarily a field).

there are also excellent free notes out there by sergei treil, at brown ("linear algebra done wrong"), and others.
 
Last edited:
  • Like
Likes kostoglotov
  • #3
An "m by n matrix" is a representation of a linear transformation from an n dimensional vector space to an m dimensional space in specific bases for the vector spaces. Two such matrices are "similar" if and only if they represent the same linear transformation, just in different bases for one or both of the vector spaces.
 
  • #4
HallsofIvy said:
An "m by n matrix" is a representation of a linear transformation from an n dimensional vector space to an m dimensional space in specific bases for the vector spaces. Two such matrices are "similar" if and only if they represent the same linear transformation, just in different bases for one or both of the vector spaces.

Isn't similarity an equivalence relation between square matrices ?
 
  • #5
well of course everyone makes his own definitions, but probably yes, similarity is mostly used for square matrices, and the same basis is used both times. What Halls is referring to is the same idea for maps between two different spaces, with two different bases of course, and maybe most people call that simply equivalence?
 

Related to A reasonable analogy for understanding similar matrices?

What is a matrix?

A matrix is a rectangular array of numbers, symbols, or expressions arranged in rows and columns. It is commonly used in mathematics, science, and engineering to represent data and perform calculations.

What are similar matrices?

Similar matrices are matrices that have the same size and shape, and their corresponding elements follow a specific pattern. Specifically, similar matrices have the same eigenvalues and eigenvectors, which means they represent the same linear transformation.

What is an analogy?

An analogy is a comparison between two things that are seemingly different but share some common characteristics. It is often used to explain complex concepts by relating them to something more familiar.

Can you give an example of a reasonable analogy for understanding similar matrices?

Yes, a reasonable analogy for understanding similar matrices is to think of them as different versions of the same painting. Just like how a painting can be reproduced with the same colors and shapes but different sizes, similar matrices have the same elements in a different arrangement.

How can understanding similar matrices be useful in science?

Understanding similar matrices can be useful in science because it allows us to simplify complex systems and make predictions based on patterns. It is particularly helpful in fields such as physics and chemistry where equations and transformations are used to model and analyze natural phenomena.

Similar threads

  • Linear and Abstract Algebra
Replies
2
Views
741
  • Linear and Abstract Algebra
Replies
11
Views
4K
  • Linear and Abstract Algebra
Replies
2
Views
466
  • Linear and Abstract Algebra
Replies
3
Views
983
Replies
12
Views
3K
Replies
34
Views
2K
Replies
27
Views
1K
  • Linear and Abstract Algebra
Replies
8
Views
935
  • Linear and Abstract Algebra
Replies
20
Views
2K
  • Linear and Abstract Algebra
Replies
1
Views
2K
Back
Top