Can I omit using an indicator function when estimating an MLE?

  • Context: Graduate 
  • Thread starter Thread starter cdux
  • Start date Start date
  • Tags Tags
    Function Mle
Click For Summary

Discussion Overview

The discussion revolves around the use of indicator functions in the context of estimating the maximum likelihood estimator (MLE) for the Uniform distribution. Participants explore whether it is possible to derive the MLE without employing an indicator function, focusing on the implications of doing so and the methods available for estimation.

Discussion Character

  • Exploratory
  • Technical explanation
  • Debate/contested
  • Mathematical reasoning

Main Points Raised

  • One participant questions the necessity of using an indicator function when estimating the MLE for the Uniform distribution, suggesting that mentioning the boundaries of the result may suffice.
  • Another participant asserts that the uniform distribution requires either an indicator function or the use of order statistics due to the nature of its probability density function (PDF), which is flat and dependent on the parameter.
  • A participant expresses confusion over the differences between the solutions using order statistics and those using indicator functions, noting that both seem to lead to similar conclusions regarding the parameter estimation.
  • It is mentioned that the indicator formulation is maximized in the context of MLE, while order statistics provide an intuitive approach based on the distribution's characteristics.
  • Participants acknowledge that multiple estimators exist for a single parameter, including MLE and order statistics, without reaching a consensus on the superiority of one method over the other.

Areas of Agreement / Disagreement

Participants do not reach a consensus on whether the indicator function is necessary for MLE estimation in the Uniform distribution. There are competing views on the effectiveness and intuitiveness of different estimation methods.

Contextual Notes

Some limitations include the dependence on the specific characteristics of the Uniform distribution and the potential biases associated with different estimation methods. The discussion also reflects varying levels of understanding regarding the mathematical implications of using indicator functions versus order statistics.

cdux
Messages
187
Reaction score
0
When looking for a maximum likelihood estimator for the Uniform distribution I noticed that a common method is to use an indicator function. My initial understanding is that the reason for that is for taking into account the region of ℝ that x produces - or not - a non-zero probability.

If I go on finding the maximum likelihood function without involving an indicator function in the math and then in the end only mention the boundaries of effect of the result, is it correct?

I'd be happy if I can avoid it (correctly) because I find the indicator function method very unintuitive for my style.
 
Physics news on Phys.org
Hey cdux.

The uniform distribution can't use derivatives because the PDF is flat and also because the range of the PDF depends on the actual parameter (unlike the Normal distribution and others where it doesn't).

So for this particular case, you need to use either the indicator function or the order statistic to derive the estimator for the parameter of the uniform distribution.

If you are using the order statistic, then make sure you check the bias (if any iexists). Also note that when I say order statistic I mean the maximum order statistic X(n) where n is the sample size and X(n) is the nth order statistic distribution.
 
  • Like
Likes   Reactions: 1 person
I've found both types of solutions, and I have a hard time understanding the difference between the "easy" one (the 'ordered statistic' one) and the one with the indicator function: In both cases they seem to conclude with the same thing: "Since b ['a' was zero in that case but it applies for both], since b >= x by our initial assumptions, then it comes to reason that -n/b^n which is a decreasing function, must be satisfied with b = max{X1,X2,...Xn}".

Because that's what I was already doing, evaluating l'(b), then looking at it being a decreasing function and then concluding that b should be minimized to maximize L(b) which is our goal.

Unless.. the solutions with indicator functions I've been reading had been redundant and they "talked too much" so to speak. Because if you are going to explain the order of the random variables why use an indicator function to begin with?
 
Last edited:
The indicator formulation is something that can be maximized in the context of the MLE (which is all about maximizing some quantity).

The order statistics on the other hand is an intuitive method that uses the nature of the distribution and knowing that the last value is a good estimate of the actual parameter.

So in short, MLE looks at maximizing something in general and order statistic is an intuitive estimator based on the specific nature of the uniform distribution.

Whatever estimator is good is what you use and there are always multiple estimators for a single parameter (MLE, moment estimator, non-parametric etc).
 

Similar threads

  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 5 ·
Replies
5
Views
4K
Replies
3
Views
3K
  • · Replies 23 ·
Replies
23
Views
4K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 8 ·
Replies
8
Views
2K
Replies
1
Views
4K
Replies
1
Views
2K
  • · Replies 12 ·
Replies
12
Views
2K
  • · Replies 7 ·
Replies
7
Views
2K