Estimator for variance when sampling without replacement

  • Thread starter Thread starter logarithmic
  • Start date Start date
  • Tags Tags
    Sampling Variance
Click For Summary
SUMMARY

The unbiased estimator for the population variance when sampling without replacement from a finite population is given by the formula \(\left(\frac{n-1}{n}\right) \, \frac {1}{r-1}\sum_{i=1}^{r}(x_i - \bar{x})^2\), where \(\bar{x}\) represents the sample mean of the selected samples. This formula corrects for the bias introduced by sampling without replacement, contrasting with the estimator used when sampling with replacement, which is \(\frac{r-1}{r}s^2\). The discussion clarifies that the hypergeometric distribution is not applicable for estimating population variance in this context.

PREREQUISITES
  • Understanding of population variance and sample variance
  • Familiarity with the concept of unbiased estimators
  • Knowledge of sampling techniques, specifically sampling without replacement
  • Basic statistics, including means and summation notation
NEXT STEPS
  • Study the derivation of the unbiased estimator for population variance in sampling without replacement
  • Learn about the differences between sampling with and without replacement
  • Explore the implications of the hypergeometric distribution in statistical sampling
  • Investigate other statistical estimators and their properties
USEFUL FOR

Statisticians, data analysts, and researchers involved in sampling methodologies and variance estimation will benefit from this discussion.

logarithmic
Messages
103
Reaction score
0
Does anyone know the formula for an unbiased estimator of the population variance \frac{1}{n}\sum_{i=1}^{n}(x_i - \bar{x})^2 when taking r samples without replacement from a finite population \{x_1, \dots, x_n\} whose mean is \bar{x}?

A google search doesn't find anything useful other than the the special cases of when r = n the estimator is of course \frac{r-1}{r}s^2, where s^2 = \frac{1}{r-1}\sum_{i=1}^{r}(x_i - \bar{x})^2 which is of course the unbiased estimator when taking r samples with replacement.

I know that a (relatively) simple formula exists, I've seen it somewhere before, just don't remember where.
 
Last edited:
Physics news on Phys.org
MaxManus said:

Not that one. That's the distribution for the number of black balls drawn without replacement from a box with black and white balls. It isn't an estimator for the population variance.
 
logarithmic said:
Not that one. That's the distribution for the number of black balls drawn without replacement from a box with black and white balls. It isn't an estimator for the population variance.

But isn't that the distribution you described? And isn't the variance formula on the right table an estimator?
 
MaxManus said:
But isn't that the distribution you described? And isn't the variance formula on the right table an estimator?
Not really. I'm looking for an estimator, that is a function of the samples: f(X_1, ..., X_r) which itself is a random variable, such that E(f(X_1, ..., X_r)) = true population variance.

That variance formula isn't a random variable (i.e. it can't be an estimator), it's the variance of a certain random variable that counts. But a hypergeometric random variable isn't appropriate for measuring the count of the samples since, the number of samples is assumed to be fixed as r.
 
logarithmic said:
Does anyone know the formula for an unbiased estimator of the population variance \frac{1}{n}\sum_{i=1}^{n}(x_i - \bar{x})^2 when taking r samples without replacement from a finite population \{x_1, \dots, x_n\} whose mean is \bar{x}?

Hi logarithmic. With that definition of \bar{x} (which is actually the definition of the population mean) then the unbiased estimator of the population variance is simply,

\frac{1}{r}\sum_{i=1}^{r}(x_i - \bar{x})^2

However I think you really meant for \bar{x} to denote the sample mean of the "r" chosen samples rather than the population mean. In which case unbiased estimator is,

\left(\frac{n-1}{n}\right) \, \frac {1}{r-1}\sum_{i=1}^{r}(x_i - \bar{x})^2
 

Similar threads

  • · Replies 2 ·
Replies
2
Views
705
Replies
0
Views
892
  • · Replies 5 ·
Replies
5
Views
1K
  • · Replies 13 ·
Replies
13
Views
2K
  • · Replies 2 ·
Replies
2
Views
3K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 8 ·
Replies
8
Views
3K
  • · Replies 7 ·
Replies
7
Views
3K
  • · Replies 11 ·
Replies
11
Views
2K
  • · Replies 1 ·
Replies
1
Views
1K