M"Unbiased Estimator for Sigma: Theorem 3.3.1 and Practical Application | CCM

  • Thread starter Thread starter happyg1
  • Start date Start date
Click For Summary
SUMMARY

The discussion focuses on deriving an unbiased estimator for the standard deviation, σ, from a sample drawn from a normal distribution N(μ, σ²) using Theorem 3.3.1. The theorem states that if X follows a χ²(r) distribution, then E(X^k) can be expressed using the gamma function. The correct unbiased estimator is derived as E(√((n-1)/2) * (Γ((n-1)/2)/Γ(n/2)) * S) = σ, confirming the initial understanding of the relationship between sample variance and the population standard deviation.

PREREQUISITES
  • Understanding of normal distribution N(μ, σ²)
  • Familiarity with χ² distribution and its properties
  • Knowledge of the gamma function and its applications
  • Basic statistical concepts such as unbiased estimators and sample variance
NEXT STEPS
  • Study the properties of the gamma function in detail
  • Learn about the derivation of unbiased estimators in statistics
  • Explore applications of the χ² distribution in hypothesis testing
  • Investigate the implications of Theorem 3.3.1 in statistical inference
USEFUL FOR

Statisticians, data analysts, and students studying statistical inference who seek to understand unbiased estimation techniques and their practical applications in normal distributions.

happyg1
Messages
304
Reaction score
0
Hi, I'm working on the following problem and I need some clarification:
Suppose that a sample is drawn from a [tex]N(\mu,\sigma^2)[/tex] distribution. Recall that [tex]\frac{(n-1)S^2}{\sigma^2}[/tex] has a [tex]\chi^2[/tex] distribution. Use theorem 3.3.1 to determine an unbiased estimator of [tex]\sigma[/tex]
Thoerem 3.3.1 states:
Let X have a [tex]\chi^2(r)[/tex] distribution. If [tex]k>-\frac{r}{2}[/tex] then [tex]E(X^k)[/tex] exists and is given by:
[tex]E(X^k)=\frac{2^k(\Gamma(\frac{r}{2}+k))}{\Gamma(\frac{r}{2})}[/tex]
My understanding is this:
The unbiased estimator equals exactly what it's estimating, so [tex]E(\frac{(n-1)S^2}{\sigma^2})[/tex]is supposed to be[tex]\sigma^2[/tex] which is 2(n-1).
Am I going the right way here?
CC
 
Last edited:
Physics news on Phys.org
Ok, So after hours of staring at this thing, here's what I did:
I let k=1/2 and r=n-1, so the thing looks like this:
[tex]E<s>=\sigma(\sqrt{\frac{2}{n-1}}\frac{\Gamma\frac{n}{2}}{\Gamma\frac{n-1}{2}}</s>[/tex]
so I use the property of the gamma function that says:
[tex]\Gamma(\alpha)=(\alpha-1)![/tex]
which leads to:
[tex]E<s>=\sigma\sqrt\frac{2}{n-1}(n-1)</s>[/tex]
So now do i just flip over everything on the RHS,leaving [tex]\sigma[/tex] by itself and that's the unbiased estimator, i.e.
[tex]\sqrt{2(n-1)}E<s>=\sigma</s>[/tex]
Any input will be appreciated.
CC
 
Last edited:
OK
Anyone who looked and ran away, here at last is the solution: (finally)
[tex]E<s>=\sigma\sqrt{\frac{2}{n-1}} \frac{\Gamma\frac({n}{2})}{\Gamma\frac({n-1}{2})}</s>[/tex]
is indeed correct, however my attempt to reduce the RHS with the properties of the Gamma function is wrong.
The unbiased estimator is obtained by isolating the [tex]\sigma[/tex] on the RHS and then using properties of the Expectation to get:
[tex]E\left(\sqrt\frac{n-1}{2}\frac{\Gamma(\frac{n-1}{2})}{\frac\Gamma(\frac{n}{2})}S\right)=\sigma[/tex]
So at last it has been resolved. WWWWEEEEEEEEEEEeeeeeeee
CC
 
Last edited:

Similar threads

  • · Replies 2 ·
Replies
2
Views
1K
  • · Replies 8 ·
Replies
8
Views
2K
  • · Replies 11 ·
Replies
11
Views
2K
  • · Replies 15 ·
Replies
15
Views
2K
Replies
2
Views
1K
Replies
3
Views
2K
  • · Replies 5 ·
Replies
5
Views
3K
  • · Replies 5 ·
Replies
5
Views
5K
  • · Replies 1 ·
Replies
1
Views
2K
Replies
1
Views
4K