LU Factorization: Motivating Explanation & Real World Impact

[matqkks]

What is the most motivating way to introduce LU factorization of a matrix? I am looking for an example or explanation which has a real impact.

 

[HallsofIvy]

One motivation is that it makes solving equations very easy! If A= LU where, of course, L is a "lower diagonal" and U is "upper diagonal", then we can solve Ax= b by writing it as LUx= b so that Ux= y= L<sup>-1b, which can be done by 'back substitution" and then solving x= U-1y again by back substitution.

For example, if
A= LU= \begin{bmatrix}2 &amp; 0 \\ 1 &amp; 3\end{bmatrix}\begin{bmatrix}1 &amp; 3 \\ 0 &amp; 2\end{bmatrix}\begin{bmatrix}x_1 \\ x_2 \end{bmatrix}= \begin{bmatrix}2 \\ 1\end{bmatrix}
We can let Ux= y so the equation becomes
Ly= \begin{bmatrix}2 &amp; 0 \\ 1 &amp; 3\end{bmatrix}\begin{bmatrix}y_1 \\ y_2\end{bmatrix}= \begin{bmatrix}2 &amp; 1 \end{bmatrix}

The first row is equivalent to the equation 2y_1= 2 so we have immediately y_1= 1. With that value, the second equation, y_1+ 3y_2= 1 becomes 1+ 3y_2= 1 so that 3y_2= 0 and y_2= 0.

Then, since we defined y to be Ux, we have
x= \begin{bmatrix} 1 &amp; 3 \\ 0 &amp; 2 \end{bmatrix}\begin{bmatrix}x_1 \\ x_2\end{bmatrix}= \begin{bmatrix}1 \\ 0 \end{bmatrix}

Now, the second row gives the equation 2x_2= 0 so that x_2= 0 and then the top row becomes x_1+ 3x_2= x_1= 1.</sup>

 

[lurflurf]

Much of linear algebra can be seen as factoring operators. Triangular equations are easy to solve so it is helpful to solve an equation by factoring it into two triangular equations. Another views is to thing about solving an equation by a usual method like row reduction. In doing so we throw away a lot of of the matrix, and as a result if we solve many equations with the same operator we needlessly repeat work. We can by slight modification of row reduction keep this information at almost no cost. If we solve the equation many times we can reuse the information each time. This is the LU decomposition.