• Support PF! Buy your school textbooks, materials and every day products Here!

Least squares

  • Thread starter squenshl
  • Start date
  • #1
479
4

Homework Statement


Suppose that you are given a set of observations (tk,yk), k = 1,...,M.
You plot these points on a sheet & it seems that the relationship between (t,y) could be approximated with a second order polynomial.
a) Write down the model in the form y = Ax + c. Specify the vectors & matrices & give interpretation to all terms.
b) Write down the least squares estimate x(hat) for x.
c) Let the elements of x bear a physical interest. How could you assess the accuracy of the estimate x(hat)?
d) How would you assess the stability of the problem if max(k,j) |tk-tj| is very small? It may help if you draw a picture. Or better still, study the structure of the matrix A.

Homework Equations





The Attempt at a Solution


a) Not sure on this one.
b) Isn't that just using the definition of least squares.
c) Not sure on this one.
d) Not sure on this one.
 

Answers and Replies

  • #2
HallsofIvy
Science Advisor
Homework Helper
41,833
955
If the relationship between t and y were a second degree polynomial, we would have [itex]y_k= at_k^2+ bt_k+ c[/tex] for all x and y. That can be written as
[tex]\begin{bmatrix}y_1 & y_2 & y_3 & \cdot\cdot\cdot\end{bmatrix}= \begin{bmatrix}a & b & c\end{bmatrix}\begin{bmatrix}x_1^2 & x_1 & 1\\ x_2^2 & x_2 & 1 \\ x_3^3 & x_3 & 1\\ \cdot\cdot\cdot & cdot\cdot\cdot & cdot\cdot\cdot \end{bmatrix}[/tex]
 
  • #3
vela
Staff Emeritus
Science Advisor
Homework Helper
Education Advisor
14,632
1,268
Fixed your post up.
If the relationship between t and y were a second degree polynomial, we would have [itex]y_k= at_k^2+ bt_k+ c[/itex] for all t and y. That can be written as
[tex]\begin{bmatrix}y_1 \\ y_2 \\ y_3 \\ \vdots\end{bmatrix}= \begin{bmatrix}t_1^2 & t_1 & 1\\ t_2^2 & t_2 & 1 \\ t_3^3 & t_3 & 1\\ \vdots & \vdots & \vdots \end{bmatrix}\begin{bmatrix}a \\ b \\ c\end{bmatrix}[/tex]
 
  • #4
479
4
Thanks.
For b) is it just using the definition of least squares otherwise what do I do?
 
  • #5
479
4
Still lost, any ideas.
 
  • #6
479
4
What exactly does it mean write down the least squares estimate x(hat)?
 
  • #7
vela
Staff Emeritus
Science Advisor
Homework Helper
Education Advisor
14,632
1,268
Do you know what the least squares method is used for?
 
  • #8
479
4
Isn't it to fit a polynomial through a set of points where the idealized value provided by the model for any data point is expressed linearly in terms of the unknown parameters of the model.
For c) does that mean assume x is real world data and if so how do you assess the accuracy of x(hat)?
For d) How do I assess the stability of the problem if maxk,j |tk - tj| is very small, not too sure on these problems, please help.
 
  • #9
vela
Staff Emeritus
Science Advisor
Homework Helper
Education Advisor
14,632
1,268
Isn't it to fit a polynomial through a set of points where the idealized value provided by the model for any data point is expressed linearly in terms of the unknown parameters of the model.
So in this problem, the method is used to calculate what exactly?
For c) does that mean assume x is real world data and if so how do you assess the accuracy of x(hat)?
Could you clarify what you mean by "real world data"? The data in this problem are the pairs (tk, yk).
For d) How do I assess the stability of the problem if maxk,j |tk - tj| is very small, not too sure on these problems, please help.
Surely, the topic of stability must have been covered in your book or lecture. What do you know about it?

So far, all you've done is ask for the answers to the question. You need to show some effort that you've tried to figure out the problems on your own.
 

Related Threads on Least squares

  • Last Post
Replies
1
Views
2K
  • Last Post
Replies
7
Views
725
  • Last Post
Replies
3
Views
958
  • Last Post
Replies
3
Views
5K
  • Last Post
Replies
1
Views
784
  • Last Post
Replies
4
Views
893
  • Last Post
Replies
10
Views
737
  • Last Post
Replies
0
Views
2K
  • Last Post
Replies
1
Views
1K
  • Last Post
Replies
6
Views
2K
Top