# [SOLVED] Statistics: Cherry picking data?

1. May 17, 2014

### Nikitin

1. The problem statement, all variables and given/known data
http://www.math.ntnu.no/~haakont/grunnkurs/oppg/eksDes11e.pdf [Broken]
Please take the time to read problem 3 ("Oppgave 3) b, to understand what I am talking about. Everything's explained there.

The specific part I am curious about:

"Define a 90 % confidence interval for $\hat{\beta_1}$. Find the actual result of the interval given the
numbers above.
The company discusses whether the confidence interval could have been shorter if they
instead collected three core samples in both rock types 1 and 3, and only one in rock
type 2? Or what if they took one sample in both of rock types 1 and 3, and five samples

Here they ask if it's a good idea to cherry pick the rock types measured in order to reduce the variance of $\hat{\beta_1}$ (the slope of the regression line), and hence make the confidence interval of $\hat{\beta_1}$ smaller.

2. Relevant equations
$Y_i = \beta_0 + \beta_1 x_i + \epsilon_i$

3. The attempt at a solution

Well, I guess from the math it's quite obvious that $SS_{xx}$ WILL become smaller if you collect samples from primarily rock type 1 and 3, and hence the prediction of the slope becomes more accurate. BUT won't the independence of the error terms condition be hurt by this? Unless they are identically normally distributed regardless of rock type?

And isn't it kind of like cheating?

EDIT: Hmm I think I understand now why this trick works. The bigger $\Delta y$ is between the data points, the less will each data point's random error screw up the accuracy of $\hat{\beta_1}$. OK, I guess I answered my questions after writing everything down on text.

Last edited by a moderator: May 6, 2017
2. May 18, 2014

### Staff: Mentor

Right. It is not cheating if you decide which samples to take in advance (or at least consider "what would have happened if we did that"), and then use all those samples in the analysis.

I hope no company actual uses such a strange model, however - there is absolutely no reason why a linear regression to rock categories should give anything meaningful.