Solving Householder Matrix Problem

  • Context: MHB 
  • Thread starter Thread starter Jameson
  • Start date Start date
  • Tags Tags
    Matrix
Click For Summary
SUMMARY

The discussion focuses on the properties of the Householder matrix, defined as $$H = I_n - 2 \frac{vv^T}{v^Tv}$$ for a non-zero column vector $v$. Participants confirm that $H$ is symmetric, as shown by the equality $H = H^T$, and they derive that the product $HH^T$ equals the identity matrix $I_n$. The proof involves matrix multiplication and properties of transposition, leading to a complete verification of the Householder matrix's characteristics.

PREREQUISITES
  • Understanding of matrix operations, including multiplication and transposition.
  • Familiarity with the concept of the Householder transformation.
  • Knowledge of linear algebra, specifically properties of symmetric matrices.
  • Ability to manipulate and simplify matrix expressions.
NEXT STEPS
  • Study the derivation of the Householder transformation and its applications in numerical linear algebra.
  • Learn about the properties of symmetric matrices and their implications in various mathematical contexts.
  • Explore the use of Householder matrices in QR decomposition and other matrix factorization techniques.
  • Investigate the relationship between Householder transformations and orthogonal matrices.
USEFUL FOR

Mathematicians, computer scientists, and engineers interested in linear algebra, numerical methods, and matrix theory will benefit from this discussion, particularly those working with transformations and matrix decompositions.

Jameson
Insights Author
Gold Member
MHB
Messages
4,533
Reaction score
13
Problem: Let $H$ be an $n \times n$ householder matrix given by $$H = I_n-2 \frac{vv^T}{v^Tv}$$ for any non-zero $n$-length column vector $v$. Show that $H=H^T$ and $HH^T=I_n$.

Attempt: a) Let's look at $H$ written out in matrix form for an 3x3 matrix. I believe it would look like this.

$$H_{3 \times 3}=\left( \begin{array}{ccc}1-2 \frac{vv^T}{v^Tv} &-2 \frac{vv^T}{v^Tv}&-2 \frac{vv^T}{v^Tv} \\ -2 \frac{vv^T}{v^Tv}&1-2 \frac{vv^T}{v^Tv}&-2 \frac{vv^T}{v^Tv}\\-2 \frac{vv^T}{v^Tv}&-2 \frac{vv^T}{v^Tv}&1-2 \frac{vv^T}{v^Tv} \end{array} \right)$$.

Clearly here $H=H^T$. I believe showing this in the general case requires some tricky notation for me. Any ideas to get started on generalizing this?

b) To show $HH^T=I_n$ we start by looking at $$\left(I_n-2 \frac{vv^T}{v^Tv}\right) \left(I_n-2 \frac{vv^T}{v^Tv} \right)^T$$

I'm familiar with rules of matrix multiplication and transpose when products are involved, but when sums are there I'm hoping I can FOIL these terms.

Let's start with the fact from (a) that I haven't proved yet that $H=H^T$. That means that:

$$\left(I_n-2 \frac{vv^T}{v^Tv}\right)^T=\left(I_n-2 \frac{vv^T}{v^Tv}\right)$$ so the original product becomes:

$$\left(I_n-2 \frac{vv^T}{v^Tv}\right) \left(I_n-2 \frac{vv^T}{v^Tv}\right) $$

I don't know exactly where to go from here...
 
Physics news on Phys.org
Jameson said:
Clearly here $H=H^T$. I believe showing this in the general case requires some tricky notation for me. Any ideas to get started on generalizing this?

Using well known properties of tranposition and taking into account that $\dfrac{2}{v^tv}$ is an scalar:

$H ^T= \left(I_n-2 \dfrac{vv^T}{v^Tv}\right)^T=I_n^T-\dfrac{2}{v^tv}(vv^T)^T=I_n^T-\dfrac{2}{v^tv}(v^T)^Tv^T\\=I_n^T-\dfrac{2}{v^tv}(vv^T)=I_n-2 \dfrac{vv^T}{v^Tv}=H$

To show $HH^T=I_n$ use that $HH^T=H^2,$ that $I_n$ commutes with all matrix $n\times n$ and
$(A-B)^2=A^2-2AB+B^2$ if $AB=BA.$
 
Here you have a complete proof of $HH^T=I_n$ for if you want to verify your work:

Using that $I_n$ commutes with all $n\times n$ matrix:

$HH^T=H^2= \left( I_n-2 \dfrac{vv^T}{v^Tv}\right)^2=I_n^2-4I_n \dfrac{vv^T}{v^Tv}+4\left (\dfrac{vv^T}{v^Tv} \right)^2\\=I_n-4\dfrac{vv^T}{v^Tv}+4\dfrac{vv^T}{v^Tv}\dfrac{vv^T}{v^Tv}$

Using that $v^Tv$ is an scalar:

$\dfrac{vv^T}{v^Tv}\dfrac{vv^T}{v^Tv}=\dfrac{1}{v^Tv}\dfrac{1}{v^Tv}v(v^Tv)v^T=\dfrac{1}{v^Tv}\dfrac{1}{v^Tv}(v^Tv)(vv^T)=\dfrac{vv^T}{v^Tv}$

So, $HH^T=I_n,$ i.e. $H$ is orthogonal.
 

Similar threads

  • · Replies 7 ·
Replies
7
Views
3K
  • · Replies 14 ·
Replies
14
Views
3K
  • · Replies 2 ·
Replies
2
Views
3K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 11 ·
Replies
11
Views
3K
  • · Replies 8 ·
Replies
8
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 21 ·
Replies
21
Views
3K
  • · Replies 7 ·
Replies
7
Views
3K