Estimate Standard Deviation of Mean Average w/ Maximum Likelihood

Click For Summary
SUMMARY

The standard deviation for the mean average of a Poisson distribution can be accurately estimated using the maximum likelihood method. The log-likelihood function, denoted as logL(λ), is utilized to determine the variance of the maximum likelihood estimator, where the variance is calculated as Var(λ) = λ/n. The standard deviation is then derived as the square root of the variance. This method confirms that a deviation of one unit from the mean average corresponds to a change of -2*ln(L) in the likelihood function, validating the interpretation of standard deviation in this context.

PREREQUISITES
  • Understanding of Poisson distribution properties
  • Familiarity with maximum likelihood estimation (MLE)
  • Knowledge of log-likelihood functions
  • Basic calculus for differentiation
NEXT STEPS
  • Study the derivation of the log-likelihood function for Poisson distributions
  • Learn about variance and standard deviation calculations in maximum likelihood estimation
  • Explore the implications of the Central Limit Theorem on Poisson distributions
  • Investigate other distributions and their maximum likelihood estimators
USEFUL FOR

Statisticians, data analysts, and researchers working with Poisson distributions and maximum likelihood estimation techniques will benefit from this discussion.

Thinkmarble
Messages
6
Reaction score
0
How do I estimate the standart deviation for the mean average of an poisson-distribution ?
The mean average was estimated with the maximum-likelihood method by graphing the likelihood in dependence of the mean average, then just reading off the value for which the likelihood became maximal.
Up to this point I had not problem.
But I also have to determine the standard deviation for my estimation of the mean average.
And that is where I run into problems.
I'm told that "by an deviation from (...) the mean average of the standart deviation the -2*ln(L) function increases by one unit compared with the minimum".
If I understand that correctly:
Minimum of the log-likelihood is 100 at an mean average of a.
At an mean average of b my log-likelihood has the value 101(99).
So my standart deviation is a-b.

Is this interpretation correct ?
 
Physics news on Phys.org
Thinkmarble said:
How do I estimate the standart deviation for the mean average of an poisson-distribution ?
The mean average was estimated with the maximum-likelihood method by graphing the likelihood in dependence of the mean average, then just reading off the value for which the likelihood became maximal.
Up to this point I had not problem.
But I also have to determine the standard deviation for my estimation of the mean average.
And that is where I run into problems.
I'm told that "by an deviation from (...) the mean average of the standart deviation the -2*ln(L) function increases by one unit compared with the minimum".
If I understand that correctly:
Minimum of the log-likelihood is 100 at an mean average of a.
At an mean average of b my log-likelihood has the value 101(99).
So my standart deviation is a-b.

Is this interpretation correct ?
Not exactly clear what you're trying to say. For traditional approaches to Maximum Likelihood Estimators, the Likelihood Function "L(θ)" is obtained, and the Variance of the Maximum Likelihood Estimator [tex]\mathbf{\hat{\theta}}[/tex] is given by:

[tex]1: \ \ \ \ \ Var(\mathbf{\hat{\theta}}) \ = \ \left ( - \, \frac{d^{2}L(\theta) } {d \theta^{2}} \right )^{\mathbf{-1}}_{\mathbf{ \theta = \hat{\theta}} }[/tex]

Thus, for the Poisson Distribution with Log Likelihood Function "logL(λ)" (and using the fact that the Maximum Likelihood Estimator of "[itex]\lambda[/itex]" is {[tex]\hat{\lambda} = \overline{x}[/tex]}:

[tex]2: \ \ \ \ \ \ Var(\hat{\lambda}) \ = \ Var(\overline{x}}) \ = \ \frac {(\hat{\lambda})^{2}} {\sum_{i=1}^{n} \, x_{i} } \ = \ \frac {(\bar{x})^{2}} {n \bar{x} } \ = \ \frac { \overline x} {n}[/tex]

Thus, for the Poisson Distribution, the Variance of "([itex]\overline{x}[/itex])" is estimated by dividing the value of "([itex]\overline{x}[/itex])" by the sample size "n". Remember that the Standard Deviation will be the Sqrt of the Variance.

(Note: FYI, recall for the Poisson Distribution, we have {λ = μ = σ2}).


~~
 
Last edited:



Yes, your interpretation is correct. The standard deviation for the mean average of a Poisson distribution can be estimated using the maximum likelihood method. This is done by graphing the likelihood function in terms of the mean average and finding the value that maximizes the likelihood. This value will be the estimated mean average. To determine the standard deviation, you can use the fact that a deviation of one unit from the mean average will result in a change of -2*ln(L) in the likelihood function. This means that the difference between the estimated mean average and the true mean average is equal to the standard deviation. In your example, if the minimum of the log-likelihood is at a mean average of a=100 and at a mean average of b=101, the standard deviation would be 1. This approach is a valid way to estimate the standard deviation for the mean average of a Poisson distribution.
 

Similar threads

  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 16 ·
Replies
16
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 11 ·
Replies
11
Views
3K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 14 ·
Replies
14
Views
3K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 8 ·
Replies
8
Views
2K