How can QR decomposition be used to solve least squares problems?

Click For Summary
SUMMARY

The discussion focuses on using QR decomposition to solve least squares problems, specifically for the equations x_1 + x_2 = 4, 2x_1 + x_2 = -2, and x_1 - x_2 = 1. The solution involves finding the QR factorization of matrix A, where A = QR, and applying it to the least squares equation A^TAx = A^Tb. By substituting A with QR, the equation simplifies to Rx = Q^Tb, leading to the least squares solution x = R^{-1}Q^Tb. This method effectively utilizes the properties of orthonormal matrices to derive the solution.

PREREQUISITES
  • Understanding of QR decomposition and its properties
  • Familiarity with least squares solutions in linear algebra
  • Knowledge of matrix operations, including transpose and inverse
  • Basic proficiency in solving systems of linear equations
NEXT STEPS
  • Study the derivation of QR decomposition and its applications in linear regression
  • Learn about the properties of orthonormal matrices and their significance in QR factorization
  • Explore numerical methods for computing the inverse of matrices, particularly R in the context of least squares
  • Investigate alternative methods for solving least squares problems, such as Singular Value Decomposition (SVD)
USEFUL FOR

Students and professionals in mathematics, engineering, and data science who are working on linear algebra problems, particularly those involving least squares solutions and QR decomposition techniques.

epkid08
Messages
264
Reaction score
1

Homework Statement


Okay so I'm supposed to find the least squares solution of a set of equations, which I can do, but it adds that I must use QR decomposition. I don't really know how to apply QR decomposition to this problem.

Problem: Find the least squares solution of
x_1 + x_2 = 4
2x_1+x_2 = -2
x_1 - x_2 = 1

Use your answer to find the point on the plane spanned by (1,1,2) and (1,-3,1) that is closest to (1,4,3).



Homework Equations





The Attempt at a Solution

 
Physics news on Phys.org
Forget the least squares stuff for a moment. Find the QR factorization of A, so we have A = QR. For least squares, you need to solve the equation A^TAx = A^Tb right? So substitute in A = QR to get (QR)^T(QR) = R^TQ^TQR. The whole gimmick of orthonormal matrices such as Q is that Q^TQ = I, so we have A^TAx = R^TRx = (QR)^Tb. So R^TRx= R^TQ^Tb. sp the least squares equation comes down to Rx = Q^Tb. But R is invertible, so the least squares solution is just

x = R^{-1}Q^Tb
 

Similar threads

  • · Replies 9 ·
Replies
9
Views
2K
  • · Replies 1 ·
Replies
1
Views
4K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
Replies
8
Views
3K
Replies
7
Views
2K
  • · Replies 15 ·
Replies
15
Views
3K
  • · Replies 22 ·
Replies
22
Views
3K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 5 ·
Replies
5
Views
2K