Rao-Blackwells Theorem: Efficient Estimation Using Sufficient Statistics

  • Context: Graduate 
  • Thread starter Thread starter Zaare
  • Start date Start date
  • Tags Tags
    Theorem
Click For Summary

Discussion Overview

The discussion revolves around the application of Rao-Blackwell's theorem in the context of estimating a parameter \(\theta\) using sufficient statistics. Participants explore how to derive an efficient estimator starting from an initial estimate.

Discussion Character

  • Exploratory, Technical explanation, Homework-related, Mathematical reasoning

Main Points Raised

  • One participant presents the problem of estimating \(\theta\) using the sufficient statistic \(T=\sum_{i=1}^n X_i\) and the initial estimate \(U=X_1\).
  • Another participant suggests calculating the sum of the expectation values of \(X_i\) conditioned on the sufficient statistic, proposing that it can be equated to \(n \cdot g(t)\).
  • A subsequent reply clarifies that the calculation involves \(\sum_{i=1}^n E(X_i | T = t)\) and relates it to \(ng(t) = nE(U|T=t) = nE(X_1|T=t)\).
  • Further, a participant encourages simplifying the expression to reach a clearer understanding of the final result.
  • One participant expresses concern about arriving at the arithmetic mean and questions whether their interpretation aligns with the intended approach.

Areas of Agreement / Disagreement

Participants appear to be in agreement about the steps to calculate the estimator, but there is some uncertainty regarding the interpretation of the results and whether the arithmetic mean is the expected outcome.

Contextual Notes

Participants do not explicitly state all assumptions or dependencies on definitions, and there may be unresolved steps in the mathematical derivation.

Zaare
Messages
54
Reaction score
0
Given the facts

1. [tex]X_1 ,...,X_n[/tex] are independent and have the same distribution.

2. The expectation value of [tex]X_i[/tex] is [tex]E\left( {X_i } \right) = \theta[/tex].

3. [tex]T=\sum\limits_{i = 1}^n {X_i }[/tex] is a sufficient statistic.

I'm asked to find an astimate for [tex]\theta[/tex] starting with the estimate [tex]U=X_1[/tex].

According to Rao-Blackwells theorem, the new estimate is taken as [tex]g(t)=E(U|T=t)[/tex].

I don't know how to calculate this expression further. Any help or tip would be appreciated.
 
Physics news on Phys.org
I would calculate the sum of the expectation value of X_i conditioned on the sufficient statistic. That sum can then be equated to n*g(t).
 
Ok, I think I get it. You mean I should calculate this:
[tex]\sum\limits_{i = 1}^n {E\left( {X_i |T = t} \right)}[/tex]

And that would equal this:
[tex]ng(t)=nE(U|T=t)=nE(X_1|T=t)[/tex]
 
Last edited:
Yes, simplify the top expression, and it should become pretty clear. Your final answer should not surprise you.
 
No, you're right. I got the arithmetic mean. Hopefully that's what you meant and I haven't done something very wrong.
 

Similar threads

  • · Replies 2 ·
Replies
2
Views
3K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 9 ·
Replies
9
Views
4K
Replies
1
Views
5K
  • · Replies 11 ·
Replies
11
Views
3K
Replies
24
Views
6K
  • · Replies 2 ·
Replies
2
Views
4K