Linear algebra row reduction

In summary, matrix row reduction involves systematically performing row operations to get a 1 in the upper left corner, 0s below it, and a 1 in the middle entry with 0s above and below it. This process continues until a 1 is achieved in the lower right entry with 0s above it. The operations are not random and may involve swapping rows or multiplying a row by a constant. To achieve reduced row-echelon form, additional steps are taken to have 0s both above and below the pivot entries. This process can be simplified by dividing each row by the pivot entry and subtracting multiples of the pivot row from the other rows.
  • #1
How exactly do you decide which operations to do in doing a matrix row reduction? Every example I see just randomly multiplies the rows or does row operations and magically they get the answer. HOW do you know to do certain operations? I understand the reduced row echelon form but it still doesn't help me.

[PLAIN] [Broken]
Last edited by a moderator:
Physics news on
  • #2
The operations aren't at all random. The goal is to get a 1 entry in the upper left corner, and 0s below it, then a 1 in the middle entry, with 0's below it (and above it if you're going for reduced row-echelon form). Finally, get a 1 in the lower right entry (and 0s above for reduced row-echelon form).

Sometimes people will swap row if it looks like it might reduce the number of steps. In this case I might swap rows 1 and 2, and then replace row 1 by -1 times itself. That would give me
[tex]\left[ \begin{array}{c c c} 1 & -1 & 1 \\ 2 & 1 & 8\\-2 & 5 & 4 \end{array}\right] [/tex]

I would then use the 1 in the upper left to elimanate the entries directly below it, and so on, as described above.
  • #3
Or, for a strict, "algorithmic" method:
work one column at at time.
1. Divide every term in the first row by 2.
2. Subtract the first row multiplied by whatever number is in each of the other rows from that row. That is
a) subtract -1 times the first row from the second row.
b) subtract -2 times the first row from the third row.

That will give you
[tex]\begin{bmatrix} 1 & \frac{1}{2} & 4 \\ 0 & \frac{3}{2} & 3 \\ 0 & 6 & 12\end{bmatrix}[/tex]

Then, for the second row do basically the same thing, dividing the second row by 3/2 to get "1" at that position. Notice that, because of those "0"s in the first column, nothing you do will change the first column!
  • #4
I can do the operations but I just end up going in circles never getting to [1, 0, 0] [0, 1, 0] [0, 0, 1]. How do you know what to do without doing a million steps?
  • #5
I think I solved it? {[1, 0, 3] [0, 1, 2] [0, 0, 0]}
  • #7
This is really frustrating me. The piece of **** book my idiot professor is using, A First Course in Linear Algebra by Robert Beezer, is not written for sophomores as it gives absolutely no problem solving techniques or useful examples. I think it assumes previous knowledge in linear algebra and discrete structures because I have no idea what it's talking about most of the time, but anyways...could someone recommend me a book at the sophomore level?
  • #8
Did you not understand what I (and Mark44) said? Start with the left column and work to the right. For each column, make the "pivot" number (the number on the main diagonal) by dividing that entire row by the number that is there to start with. Then get the number each row above below that "pivot" row (the one containing the pivot number) equal to 0 by subtracting the "pivot" row times that number from the row.

If the first column were
[tex]\begin{bmatrix}a \\ b \\ c[/tex]
the "pivot" row is the first row and the "pivot" number is a. Divide each number in the first row by a. Now you have
[tex]\begin{bmatrix}1 \\ b \\ c\end{bmatrix}[/tex]
and you want "0" in place of "b" and "c". Subtract the first row time b from the second row. Subtract the first row times c from the third row. Since you now have "1" in the first row, you will be subtracting b- b and c- c in the second and third rows and have "0" there:
[tex]\begin{bmatrix}1 \\ 0\\ 0\end{bmatrix}[/tex]

Suppose, after that, the second column is
[tex]\begin{bmatrix}d \\ e\\ f\end{bmatrix}[/tex].
Since this is the second column, the "pivot" row is the second row. The "pivot" number is e. Divide the entire second row by e so the second column is now
[tex]\begin{bmatrix}d \\ 1 \\ f\end{bmatrix}[/tex]

To get "0"s in place of f, subtract f times the second row from the third row. At this point you have
\(\displaystyle \begin{bmatrix}1 & d & * \\ 0 & 1 & * \\ 0 & 0 & *\end{bmatrix}\)
where the "*"s in the third column indicate the numbers that we need to "fix" yet. Of course, they will NOT be the same numbers that were in the original matrix since they have been changed by the "dividing" and "subtracting" of the entire rows.

("Reduced row-echelon" has "0"s both above and below the "pivot". You would get the "0" above the "pivot" number by subtracting d times the second row from the first row.)

Suppose those number in the third (and, in this example, last) column are \
[tex]\begin{bmatrix}g \\ h \\ i\end{bmatrix}[/tex]
Since this is the third column the "pivot" row is the third row and the "pivot" number is i. Get a "1" there by dividing the entire third row by i. Now we have
[tex]begin{bmatrix}g \\ h \\ 1\end{bmatrix}[/tex]
For "row-echelon" that's all you have to do. For "reduced row-echelon" you would want to get "0" in the first and second rows of the third column by subtracting as above.
The example you gave in your post,
[tex]\begin{bmatrix} 2 & 1 & 8 \\ -1 & 1 & -1 \\ -2 & 5 & 4\end{bmatrix}[/tex]
would go like this:

Divide every number in the first column by 2 to get a "1" in the first column. Then subtract -1 times the new first row (add 1 times the new first row) from the second row and subtract -2 times the new first row (add 2 times the new first row) from the third row. That gives
[tex]\begin{bmatrix}1 & \frac{1}{2} & 4 \\ 0 & \frac{3}{2} & 3 \\ 0 & 6 & 12\end{bmatrix}[/tex]
That is exactly what I gave before.

Look at the second column. The "pivot" row is the second row and the "pivot" number is \(\displaystyle 3/2\). Divide every number in the second rwo by \(\displaystyle \frac{3}{2}\). Then, since there is a "6" just below that "pivot" number, subtract 6 times the second row from the third. You should now have:
[tex]\begin{bmatrix}1 & \frac{1}{2} & 4 \\ 0 & 1 & 2 \\ 0 & 0 & 0\end{bmatrix}[/tex]

We would like to have a "1" in the third row, third column, but we can't. This matrix is not "invertible" (one way of finding an inverse for a matrix is to put it into "reduced row-echeolon" form, which would give you the identity matrix, while simultaneously performing the same row-operations on the identity matrix- if you can't do that, the matrix is not invertible). But what we have is the "row-echelon" form for this matrix.

Mark44 started by swapping two rows- that can make the calculations easier. Since we always divide a row by the "pivot" number, if that number happens to be 0, we will need to swap with a lower row. If there are NO non-zero numbers lower in the same column, that means the matrix is not invertible and you cannot proceed. What you have is the "row-reduced" matrix.

What is linear algebra row reduction?

Linear algebra row reduction is a process used to manipulate and simplify a system of linear equations by using a set of elementary row operations. The goal is to reduce the equations to a simpler form that is easier to solve.

What are the elementary row operations?

The three elementary row operations are: 1) multiplying a row by a non-zero constant, 2) adding a multiple of one row to another row, and 3) swapping the positions of two rows. These operations do not change the solutions to the system of equations.

Why is row reduction important in linear algebra?

Row reduction is important because it allows us to solve systems of equations and find the solutions to real-world problems. It also helps in finding the inverse of a matrix and determining linear independence.

What is the purpose of the reduced row echelon form?

The reduced row echelon form is a special form that a matrix can be reduced to using row reduction. It has the advantage of being easy to read and interpret, making it useful for solving systems of equations and performing other operations on matrices.

Can row reduction be used for any type of matrix?

Yes, row reduction can be used for any type of matrix, including square matrices, rectangular matrices, and augmented matrices. However, the process may be slightly different depending on the size and type of matrix.

Suggested for: Linear algebra row reduction