On the Moore–Penrose inverse from a banal linear algebra viewpoint

  • Thread starter Thread starter wrobel
  • Start date Start date
wrobel
Science Advisor
Insights Author
Messages
1,260
Reaction score
1,062
Usually, the theory of the Moore-Penrose inverse looks like some profound material, but it is actually a combination of several standard linear algebra theorems, provided the definition is introduced properly. Such things happen from time to time in peripheral or special fields.
Let $$A:X\to Y,\quad X=\mathbb{R}^m,\quad Y=\mathbb{R}^n$$ be a linear operator and take a subspace ##F\subset X## such that
$$X=F\oplus \ker A.$$
Let ##P:X\to F## be the projection along the subspace ##\ker A##.

Theorem 1. There exists a unique operator ##B:F\to A(X)## such that ##A=BP.## The operator ##B## is an isomorphism.

Equip the spaces ##X## and ##Y## with inner products ##(\cdot,\cdot)_X## and ##(\cdot,\cdot)_Y## respectively.
Recall that
$$A^*:Y\to X,\quad (Ax,y)_Y=(x,A^*y)_X.$$

Theorem 2. The following orthogonal decompositions hold:
$$X=\ker A\oplus A^*(Y),\quad \ker A\perp A^*(Y);\quad Y=\ker A^*\oplus A(X),\quad \ker A^*\perp A(X).$$
Let ##P_x:X\to A^*(Y),\quad P_y:Y\to A(X)## be the corresponding orthogonal projections.

From Theorem 1 we know that there is a unique isomorphism ##\tilde A: A^*(Y)\to A(X)## such that ##A=\tilde AP_x.##

Definition. We shall call the operator
$$A^+=\tilde A^{-1}P_y:Y\to X$$the MP-inverse operator.

All the standard properties of this operator are easily checked. The main of them are
$$AA^+=P_y,\quad A^+A=P_x.$$
The Hilbert space generalization is evident as well.
 
Last edited:

Similar threads

  • · Replies 1 ·
Replies
1
Views
4K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 104 ·
4
Replies
104
Views
17K
  • · Replies 3 ·
Replies
3
Views
7K
  • · Replies 156 ·
6
Replies
156
Views
21K
  • · Replies 28 ·
Replies
28
Views
7K
  • · Replies 6 ·
Replies
6
Views
5K
  • · Replies 175 ·
6
Replies
175
Views
27K
  • Poll Poll
  • · Replies 3 ·
Replies
3
Views
5K