Least Squares Derivation—Simple Algebraic Simplification

AI Thread Summary
The discussion focuses on clarifying a step in the derivation of the least squares method, specifically the transition from the last step on page 7 to the final equation on page 8. The main point of confusion is regarding the denominator, which appears to be a difference of two terms rather than a sum. It is noted that the author incorrectly modifies the signs when simplifying the equation, leading to a misunderstanding of the denominator's structure. The correct interpretation involves recognizing that the sign change should reflect a minus sign in the denominator. This clarification is essential for accurately understanding the least squares derivation.
END
Messages
36
Reaction score
4
Hey, PF

I'm reading the following derivation of least squares, and I'm trying to figure out how the author went from the last step at the bottom of pg. 7 to the final equation (11) at the top of pg. 8.

[http://isites.harvard.edu/fs/docs/icb.topic515975.files/OLSDerivation.pdf]

More specifically, why is the denominator a difference of two terms? Aren't the terms in the denominator summed in the prior step?

I would expect the answer to be

$$
b_1=\dfrac{\displaystyle \sum_{\textrm{i=1}}^{n}y_ix_{i}-\left(\frac{1}{n}\right)\left(\sum_{\textrm{i=1}}^{n}y_i\sum_{\textrm{i=1}}^{n}x_{i}\right)}{\displaystyle\sum_{\textrm{i=1}}^{n}x_{i}^2+\left(\frac{1}{n}\right)\left(\sum_{\textrm{i=1}}^{n}x_{i}\right)^{2}}
$$

Note: I'm no statistician, but I thought you guys might be more familiar with this derivation.
 
Physics news on Phys.org
I think you are right. The step only "divides both sides of the equation by the quantity in the large brackets on the left side" as the text states.

So, the sign doesn't change and will be the sum of the two terms in the denominator as you wrote out above.
 
But the the mistake is a few steps before that where the text reads "Multiplying out the last term on the right". The writer removes the brackets but only changes the sign for the first term of the brackets. It is supposed to be a minus sign in the denominator (as in a difference of the two terms).
 
  • Like
Likes END
titasB said:
But the the mistake is a few steps before that where the text reads "Multiplying out the last term on the right". The writer removes the brackets but only changes the sign for the first term of the brackets. It is supposed to be a minus sign in the denominator (as in a difference of the two terms).

Thank you, TitasB!
 
  • Like
Likes titasB
I was reading documentation about the soundness and completeness of logic formal systems. Consider the following $$\vdash_S \phi$$ where ##S## is the proof-system making part the formal system and ##\phi## is a wff (well formed formula) of the formal language. Note the blank on left of the turnstile symbol ##\vdash_S##, as far as I can tell it actually represents the empty set. So what does it mean ? I guess it actually means ##\phi## is a theorem of the formal system, i.e. there is a...
Back
Top