Finding Least Square Solution for a System of Linear Equations

Click For Summary
To find the least squares solution for the given system of linear equations, the discussion emphasizes the need for orthogonal projection of the vectors involved. The user contemplates using coefficients derived from the inner product of the vectors, but expresses reluctance to employ methods involving positive definiteness due to complexity. It is noted that for orthogonal projection, the basis vectors must be orthogonal, suggesting the potential use of the Gram-Schmidt process to achieve this. The challenge of ensuring that the vector b lies within the range of K is acknowledged, indicating the problem's complexity. Ultimately, converting to an orthogonal basis is proposed as a viable approach for obtaining the least squares solution.
Mindscrape
Messages
1,854
Reaction score
1
This is a pretty basic question, but I just want to make sure. The question is to find the least square solution for
\newcommand{\colv}[2] {\left(\begin{array}{c} #1 \\ #2 \end{array}\right)}<br /> \left(<br /> \begin{array}{cc}<br /> 1 &amp; 2\\<br /> 2 &amp; 4<br /> \end{array}<br /> \right) x = \colv{2}{2}

I can just find the orthogonal projection of the two vectors, right? In other words, use the find w = a_1\mathbf{v_1} + a_2\mathbf{v_2}
\newcommand{\colv}[2] {\left(\begin{array}{c} #1 \\ #2 \end{array}\right)}<br /> a_1 {\colv{1}{2}} + a_2 {\colv{2}{4}} = {\colv{w_1}{w_2}}
where
a_1 = \frac{&lt;b,v_1&gt;}{||v_1||^2}
and
a_2 = \frac{&lt;b,v_2&gt;}{||v_2||^2}

I don't really want to use the method with positive definite because the numbers turn out sticky.

Then solution can be expressed as \mathbf{z} = \mathbf{b} - \mathbf{w}, such that z is orthogonal to the range of K?
 
Last edited:
Physics news on Phys.org
Two problems I just thought of though. If I want to do an orthogonal projection the basis vectors must be orthogonal. I suppose I could convert to an orthogonal basis.

Furthermore, K^T K = Kx will still not give an answer such that b is in the range of K. No wonder this problem was assigned, it's not as basic as I thought. :(

So if I convert the second vector to an orthogonal vector with Gram-Schmitt then I can use the orthogonal projection as the least squares answer?
 
Question: A clock's minute hand has length 4 and its hour hand has length 3. What is the distance between the tips at the moment when it is increasing most rapidly?(Putnam Exam Question) Answer: Making assumption that both the hands moves at constant angular velocities, the answer is ## \sqrt{7} .## But don't you think this assumption is somewhat doubtful and wrong?

Similar threads

  • · Replies 3 ·
Replies
3
Views
1K
Replies
6
Views
1K
  • · Replies 2 ·
Replies
2
Views
1K
  • · Replies 5 ·
Replies
5
Views
1K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 4 ·
Replies
4
Views
1K
Replies
9
Views
2K
Replies
0
Views
842
  • · Replies 3 ·
Replies
3
Views
1K
Replies
6
Views
1K