Is the Square Root of an Unbiased Variance Estimator Also Unbiased?

  • Thread starter Thread starter thrillhouse86
  • Start date Start date
  • Tags Tags
    Variance
AI Thread Summary
The discussion centers on the bias of variance and standard deviation estimators. The sample variance, s², is biased, with its mean expressed as μ_{s²} = (N-1)/N * σ². The modified variance estimator, ȳ = (N/(N-1))s², is considered unbiased. However, there is confusion regarding the standard deviation estimator, ȳ, being biased despite the variance being unbiased, as the expectation E(s) does not equal the square root of E(s²). The key takeaway is that while the variance can be unbiased, the square root of an unbiased variance estimator does not guarantee an unbiased standard deviation estimator.
thrillhouse86
Messages
77
Reaction score
0
Hey all,

In Schaum's outline it claims that the sample variance of s^2 is a biased estimate of the population variance because its mean is given by:
\mu_{s^{2}} = \frac{N-1}{N}\sigma^{2}

which I am cool with. It then says that the modified variance given by:
\hat{s} = \frac{N}{N-1}s^{2}
is an unbiased estimator. I know this should be really easy, but I don't know how to show it.

Also even if I accept that \hat{s}^{2} is an unbiased estimator of the variance, Schaum's outline claims that \hat{s} is a biased estimator of the population standard deviation. I don't see how this could be possible. if the variance is unbiased, and we take the square root of that unbiased estimator, won't the result also be unbiased ?

Thanks,
Thrillhouse
 
Last edited:
Physics news on Phys.org
What happens if you calculate

<br /> E(\hat{s}^2) = E\left(\frac{N}{N-1} s^2\right)<br />

using the first result you mention.

On the second point: you could work out the distribution of s and then find the expectation and see that E(s) \ne \sigma, or simply take as explanation the fact that even thought

<br /> s = \sqrt{s^2}<br />

it is not true that

<br /> E(s) = \sqrt{E(s^2)}<br />

which would have to be true to have s as an unbiased estimator of \sigma.
 
thrillhouse86 said:
Hey all,

In Schaum's outline it claims that the sample variance of s^2 is a biased estimate of the population variance because its mean is given by:
\mu_{s^{2}} = \frac{N-1}{N}\sigma^{2}

which I am cool with. It then says that the modified variance given by:
\hat{s} = \frac{N}{N-1}s^{2}
is an unbiased estimator. I know this should be really easy, but I don't know how to show it.

Also even if I accept that \hat{s}^{2} is an unbiased estimator of the variance, Schaum's outline claims that \hat{s} is a biased estimator of the population standard deviation. I don't see how this could be possible. if the variance is unbiased, and we take the square root of that unbiased estimator, won't the result also be unbiased ?

Thanks,
Thrillhouse

It sounds like you are overcomplicating the problem. Your first equation shows a bias factor of (N-1)/N, so simply multiplying by N/(N-1) removes the bias.
 
I was reading a Bachelor thesis on Peano Arithmetic (PA). PA has the following axioms (not including the induction schema): $$\begin{align} & (A1) ~~~~ \forall x \neg (x + 1 = 0) \nonumber \\ & (A2) ~~~~ \forall xy (x + 1 =y + 1 \to x = y) \nonumber \\ & (A3) ~~~~ \forall x (x + 0 = x) \nonumber \\ & (A4) ~~~~ \forall xy (x + (y +1) = (x + y ) + 1) \nonumber \\ & (A5) ~~~~ \forall x (x \cdot 0 = 0) \nonumber \\ & (A6) ~~~~ \forall xy (x \cdot (y + 1) = (x \cdot y) + x) \nonumber...
I was reading documentation about the soundness and completeness of logic formal systems. Consider the following $$\vdash_S \phi$$ where ##S## is the proof-system making part the formal system and ##\phi## is a wff (well formed formula) of the formal language. Note the blank on left of the turnstile symbol ##\vdash_S##, as far as I can tell it actually represents the empty set. So what does it mean ? I guess it actually means ##\phi## is a theorem of the formal system, i.e. there is a...
Back
Top