Show that the maximum likelihood estimator is unbiased

Click For Summary

Discussion Overview

The discussion revolves around the maximum likelihood estimator (MLE) for a specific density family and the question of whether this estimator is unbiased. Participants explore the derivation of the MLE and the calculation of its expectation, considering the implications for unbiasedness.

Discussion Character

  • Technical explanation
  • Mathematical reasoning
  • Debate/contested

Main Points Raised

  • One participant presents the density family and proposes the MLE as ${\mu}_{1}=\frac{1}{n}(\ln(X_{1})+...+\ln(X_{n}))$, suggesting that the substitution $y=\ln x$ may be useful.
  • Another participant confirms the form of the density function and the MLE, emphasizing the need to calculate the expectation of $\mu_1$ to test for unbiasedness.
  • A later reply reiterates the need to compute $E(\mu_1)$ and provides an integral expression for $E(\text{ln}X)$, indicating a potential path to evaluate the expectation.
  • Further, a participant clarifies the substitution used in the integral for $E(\text{ln}X)$, detailing the transformation from $x$ to $t=\ln x$ and the subsequent steps in the integration process.

Areas of Agreement / Disagreement

Participants generally agree on the form of the MLE and the necessity of calculating its expectation. However, there is no consensus on the unbiasedness of the estimator, as the discussion remains focused on the derivation and calculations without reaching a definitive conclusion.

Contextual Notes

Some assumptions regarding the distribution of $Y_i$ and the specific properties of the density function may not be fully explored, leaving certain aspects of the unbiasedness question unresolved.

Fermat1
Messages
180
Reaction score
0
Consider a density family $f(x,{\mu})=c_{{\mu}}x^{{\mu}-1}\exp(\frac{-(\ln(x))^2)^2}{2}$ , where $c_{{\mu}}=\frac{1}{{\sqrt{2{\pi}}}}\exp(-{\mu}^2/2)$
For a sample $(X_{1},...,X_{n})$ fnd the maximum likelihood estimator and show it is unbiased. You may find the substitution $y=\ln x$ helpful.

I find the MLE to be ${\mu}_{1}=\frac{1}{n}(\ln(X_{1})+...+\ln(X_{n}))$. For unbiasedness, I'm not sure what to do. If I substitute $y_{i}=\ln(x_{i}$ I get $E({\mu}_{1})=\frac{1}{n}(E(Y_{1})+...+E(Y_{n}))$. Am I meant to recognise the distribution of the $Y_{i}$?
 
Last edited:
Physics news on Phys.org
I'm not sure what $$f(x,\mu)$$ really is. I suppose it's

$$f(x,\mu)=c_{\mu}x^{\mu-1}\exp(-(\text{ln}x)^2/2)$$.

Give a sample $$(X_1,X_2...,X_n)$$, and you've got the MLE, $$\mu_1=\frac{1}{n}\sum_{i=1}^{n}\text{ln}X_i$$. For this $$f(x,\mu)$$, that's right.

To test the unbiasness, you should calculate the expectation of $$\mu_1$$.

Thus, we have, $$E(\mu_1)=\frac{1}{n}\sum_{i=1}^nE(\text{ln}X_i)$$.

Noting $$E(\text{ln}X)=\int_0^{\infty}\text{ln}xf(x,\mu)dx=\frac{1}{\sqrt{2\pi}}\int_{\mathbb{R}}t\exp{(-(t-\mu)^2/2)}dt$$, can you figure out this?
 
stainburg said:
I'm not sure what $$f(x,\mu)$$ really is. I suppose it's

$$f(x,\mu)=c_{\mu}x^{\mu-1}\exp(-(\text{ln}x)^2/2)$$.

Give a sample $$(X_1,X_2...,X_n)$$, and you've got the MLE, $$\mu_1=\frac{1}{n}\sum_{i=1}^{n}\text{ln}X_i$$. For this $$f(x,\mu)$$, that's right.

To test the unbiasness, you should calculate the expectation of $$\mu_1$$.

Thus, we have, $$E(\mu_1)=\frac{1}{n}\sum_{i=1}^nE(\text{ln}X_i)$$.

Noting $$E(\text{ln}X)=\int_0^{\infty}\text{ln}xf(x,\mu)dx=\frac{1}{\sqrt{2\pi}}\int_{\mathbb{R}}t\exp{(-(t-\mu)^2/2)}dt$$, can you figure out this?

what substitution are you using?
 
Fermat said:
what substitution are you using?
Let $$t=\text{ln}x\in (-\infty, \infty)$$, hence $$x=\exp(t)$$.

We then have

$$E(\text{ln}X)\\

=\int_0^{\infty}\text{ln}xc_{\mu}x^{\mu-1}\exp(-(\text{ln}x)^2/2)dx\\

=\frac{1}{\sqrt{2\pi}}\int_{\mathbb{R}}\exp(-\mu^2/2)t\exp{((\mu-1)t)}\exp{(-t^2/2)}d(\exp(t))\\

=\frac{1}{\sqrt{2\pi}}\int_{\mathbb{R}}t\exp{(-(t^2-2\mu t+\mu^2)/2)}dt\\

=\frac{1}{\sqrt{2\pi}}\int_{\mathbb{R}}t\exp{(-(t-\mu)^2/2)}dt\\$$
 

Similar threads

  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 3 ·
Replies
3
Views
3K
Replies
1
Views
4K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 19 ·
Replies
19
Views
2K
  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 8 ·
Replies
8
Views
2K
  • · Replies 5 ·
Replies
5
Views
4K
  • · Replies 6 ·
Replies
6
Views
1K
  • · Replies 12 ·
Replies
12
Views
2K