Is the Square Root of an Unbiased Variance Estimator Also Unbiased?

  • Context: Graduate 
  • Thread starter Thread starter thrillhouse86
  • Start date Start date
  • Tags Tags
    Variance
Click For Summary
SUMMARY

The discussion centers on the unbiasedness of variance and standard deviation estimators. The sample variance \( s^2 \) is established as a biased estimator of the population variance, with its expected value given by \( \mu_{s^{2}} = \frac{N-1}{N}\sigma^{2} \). The modified variance \( \hat{s}^2 = \frac{N}{N-1}s^{2} \) is confirmed as an unbiased estimator. However, the square root of this unbiased variance, \( \hat{s} \), is identified as a biased estimator of the population standard deviation, leading to the conclusion that \( E(s) \neq \sqrt{E(s^2)} \).

PREREQUISITES
  • Understanding of statistical estimators and bias
  • Familiarity with variance and standard deviation concepts
  • Knowledge of the properties of expected values
  • Basic proficiency in mathematical notation and equations
NEXT STEPS
  • Study the derivation of the expected value of the sample variance \( E(s^2) \)
  • Learn about the properties of unbiased estimators in statistics
  • Explore the implications of taking square roots of estimators
  • Investigate the concept of bias in statistical estimators further
USEFUL FOR

Statisticians, data analysts, and students studying statistical inference who need to understand the nuances of variance and standard deviation estimators.

thrillhouse86
Messages
77
Reaction score
0
Hey all,

In Schaum's outline it claims that the sample variance of s^2 is a biased estimate of the population variance because its mean is given by:
\mu_{s^{2}} = \frac{N-1}{N}\sigma^{2}

which I am cool with. It then says that the modified variance given by:
\hat{s} = \frac{N}{N-1}s^{2}
is an unbiased estimator. I know this should be really easy, but I don't know how to show it.

Also even if I accept that \hat{s}^{2} is an unbiased estimator of the variance, Schaum's outline claims that \hat{s} is a biased estimator of the population standard deviation. I don't see how this could be possible. if the variance is unbiased, and we take the square root of that unbiased estimator, won't the result also be unbiased ?

Thanks,
Thrillhouse
 
Last edited:
Physics news on Phys.org
What happens if you calculate

<br /> E(\hat{s}^2) = E\left(\frac{N}{N-1} s^2\right)<br />

using the first result you mention.

On the second point: you could work out the distribution of s and then find the expectation and see that E(s) \ne \sigma, or simply take as explanation the fact that even thought

<br /> s = \sqrt{s^2}<br />

it is not true that

<br /> E(s) = \sqrt{E(s^2)}<br />

which would have to be true to have s as an unbiased estimator of \sigma.
 
thrillhouse86 said:
Hey all,

In Schaum's outline it claims that the sample variance of s^2 is a biased estimate of the population variance because its mean is given by:
\mu_{s^{2}} = \frac{N-1}{N}\sigma^{2}

which I am cool with. It then says that the modified variance given by:
\hat{s} = \frac{N}{N-1}s^{2}
is an unbiased estimator. I know this should be really easy, but I don't know how to show it.

Also even if I accept that \hat{s}^{2} is an unbiased estimator of the variance, Schaum's outline claims that \hat{s} is a biased estimator of the population standard deviation. I don't see how this could be possible. if the variance is unbiased, and we take the square root of that unbiased estimator, won't the result also be unbiased ?

Thanks,
Thrillhouse

It sounds like you are overcomplicating the problem. Your first equation shows a bias factor of (N-1)/N, so simply multiplying by N/(N-1) removes the bias.
 

Similar threads

  • · Replies 7 ·
Replies
7
Views
3K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 42 ·
2
Replies
42
Views
5K
  • · Replies 9 ·
Replies
9
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
Replies
5
Views
5K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 23 ·
Replies
23
Views
4K
  • · Replies 1 ·
Replies
1
Views
2K
Replies
1
Views
4K