MHB Infinitely many least-square solutions

  • Thread starter Thread starter Fernando Revilla
  • Start date Start date
Click For Summary
The discussion revolves around finding a least-square solution for the inconsistent system Ax=b, where A is a 5x4 matrix and b is a vector. The least squares solutions can be derived from the equation A^TAx=A^Tb, leading to a new system that can be solved using the Gauss method. The solutions will take the form of a specific vector plus a linear combination involving a free variable x4. The provided answer options suggest different specific solutions, highlighting the infinite nature of least-square solutions. The discussion emphasizes the application of linear algebra principles to derive these solutions.
Fernando Revilla
Gold Member
MHB
Messages
631
Reaction score
0
I quote a question from Yahoo! Answers

Hard Linear Algebra Q: Find a least-square solution of the inconsistent system Ax=b.?
1 1 0 0 = A
1 1 0 0
1 0 1 0
1 0 1 0
1 0 0 1
1 0 0 1

7 = b
8
0
2
4
1The answer options are:
A) [5/2, 5, -7/2, 0] + x4[-1, 1, 1, 1]
B) [5/2, 5, -3/2, 0] + x4[-1, 1, 1, 1]
C) [5/4, 5, -3/2, 0] + x4[-1, 1, 1, 0]
D) [5/2, 4, -3/2, 0] + x4[-1, -1, 1, 1]

I have given a link to the topic there so the OP can see my response.
 
Mathematics news on Phys.org
According to a well known theorem, the least squares solutions of $Ax=b$ are the solutions of the consistent system $A^TAx=A^Tb$. In our case, you'll get;

$$A^TAx=A^Tb \Leftrightarrow \begin{bmatrix}{6}&{2}&{2}&{2}\\{2}&{2}&{0}&{0}\\{2}&{0}&{2}&{0}\\ {2}&{0}&{0}&{2}\end{bmatrix}\begin{bmatrix}{x_1}\\{x_2}\\{x_3}\\{x_4}\end{bmatrix}=\begin{bmatrix}{22}\\{15}\\{2}\\{5}\end{bmatrix}$$
Now, solve the last system using the Gauss method and you'll find solutions of the form $a+x_4v$ with $a,v\in\mathbb{R}^4$ and $x_4\in\mathbb{R}$.
 
Seemingly by some mathematical coincidence, a hexagon of sides 2,2,7,7, 11, and 11 can be inscribed in a circle of radius 7. The other day I saw a math problem on line, which they said came from a Polish Olympiad, where you compute the length x of the 3rd side which is the same as the radius, so that the sides of length 2,x, and 11 are inscribed on the arc of a semi-circle. The law of cosines applied twice gives the answer for x of exactly 7, but the arithmetic is so complex that the...