A Question about Expected value

Click For Summary

Homework Help Overview

The discussion revolves around finding the maximum likelihood estimator (MLE) for a given probability density function (pdf) that is defined for independent and identically distributed (iid) random variables. The participants are tasked with determining the MLE for the parameter θ, a constant for expected value, and the MLE for the median of the distribution.

Discussion Character

  • Exploratory, Assumption checking, Mathematical reasoning

Approaches and Questions Raised

  • Participants discuss the use of order statistics to derive the pdf for the maximum of the sample. There are attempts to express the expected value and clarify the boundaries for integration. Questions arise regarding the correctness of derived expressions and the implications of negative probabilities.

Discussion Status

Some participants have provided guidance on using the cumulative distribution function (CDF) to find the probability associated with the maximum of the sample. There is an ongoing exploration of different approaches, with multiple interpretations being considered. Participants express confusion about certain calculations and seek clarification on boundaries for integrals.

Contextual Notes

Participants note that the problem involves a nonregular case and that the pdf is defined only for specific values of x. There is mention of a link to an external solution that presents different answers, contributing to the frustration expressed by some participants.

Artusartos
Messages
236
Reaction score
0

Homework Statement



Suppose X_1, ... , X_n are iid with pdf f(x,\theta)=2x/(\theta^2), 0<x\leq\theta, zero elsewhere. Note this is a nonregular case. Find:

a)The mle \hat{\theta} for \theta.
b)The constant c so that E(c\hat{\theta})=\theta.
c) The mle for the median of the distribution.

Homework Equations


The Attempt at a Solution



a) I got \hat{\theta} = max\{X_1, ... ,X_2\}=Y_n
b) I was stuck here...

I need to find the pdf for Y_n using the order statistics formula, right?

So this is what I got...f_n(y_n)=\frac{n!}{(n-1)!(n-n)!}[F(y_n)]^{n-1}[1-F(y_n)]^{n-n}f(y_n)

= n(F(y_n))^{n-1}f(y_n)= n(\frac{-2x}{\theta})^{n-1}(\frac{2x}{\theta^2})

= n(\frac{-2x}{\theta})^{n}(\frac{\theta}{-2x})(\frac{2x}{\theta^2})

= n(\frac{-1}{\theta})(\frac{-2x}{\theta})^n

So now I want to find the expected value, but I'm not sure what the boundaries need to be for the integral...so can anybody help me?

Thanks in advance
 
Physics news on Phys.org
Artusartos said:

Homework Statement



Suppose X_1, ... , X_n are iid with pdf f(x,\theta)=2x/(\theta^2), 0<x\leq\theta, zero elsewhere. Note this is a nonregular case. Find:

a)The mle \hat{\theta} for \theta.
b)The constant c so that E(c\hat{\theta})=\theta.
c) The mle for the median of the distribution.


Homework Equations





The Attempt at a Solution



a) I got \hat{\theta} = max\{X_1, ... ,X_2\}=Y_n
b) I was stuck here...

I need to find the pdf for Y_n using the order statistics formula, right?

So this is what I got...


f_n(y_n)=\frac{n!}{(n-1)!(n-n)!}[F(y_n)]^{n-1}[1-F(y_n)]^{n-n}f(y_n)

= n(F(y_n))^{n-1}f(y_n)= n(\frac{-2x}{\theta})^{n-1}(\frac{2x}{\theta^2})

= n(\frac{-2x}{\theta})^{n}(\frac{\theta}{-2x})(\frac{2x}{\theta^2})

= n(\frac{-1}{\theta})(\frac{-2x}{\theta})^n

So now I want to find the expected value, but I'm not sure what the boundaries need to be for the integral...so can anybody help me?

Thanks in advance

The formula for ##f_n(y)## must not have x in it! Do you mean
f_n(y) = n \left( \frac{-1}{\theta} \right) \left(\frac{-2x}{\theta}\right)^n?
I hope not, because for even n this whole expression is < 0, so you have a negative probability density.

Why not just use P\{ \max(X_1,X_2, \ldots, X_n) \leq y \} = P\{ X_1 \leq y, X_2 \leq y, \ldots, X_n \leq y \}\\<br /> = F_X(y)^n for iid ##X_i##?
 
Ray Vickson said:
The formula for ##f_n(y)## must not have x in it! Do you mean
f_n(y) = n \left( \frac{-1}{\theta} \right) \left(\frac{-2x}{\theta}\right)^n?
I hope not, because for even n this whole expression is < 0, so you have a negative probability density.

Why not just use P\{ \max(X_1,X_2, \ldots, X_n) \leq y \} = P\{ X_1 \leq y, X_2 \leq y, \ldots, X_n \leq y \}\\<br /> = F_X(y)^n for iid ##X_i##?

Thank you. So...

F_X(y)=\frac{y^2}{\theta^2}, right? So...

P\{ \max(X_1,X_2, \ldots, X_n) \leq y \} = P\{ X_1 \leq y, X_2 \leq y, \ldots, X_n \leq y \} = P(X_1 \leq y)P(X_2 \leq y)...P(X_n \leq y) = (\frac{y^2}{\theta^2})^n, right?

But I'm still a bit confused about the boundaries for the intergral for the expected value...
 
Artusartos said:
Thank you. So...

F_X(y)=\frac{y^2}{\theta^2}, right? So...

P\{ \max(X_1,X_2, \ldots, X_n) \leq y \} = P\{ X_1 \leq y, X_2 \leq y, \ldots, X_n \leq y \} = P(X_1 \leq y)P(X_2 \leq y)...P(X_n \leq y) = (\frac{y^2}{\theta^2})^n, right?

But I'm still a bit confused about the boundaries for the intergral for the expected value...

Of course you need ##0 \leq y \leq \theta## in the above. For ##y > \theta## we have ##F_Y(y) = 1##.
 
Ray Vickson said:
Of course you need ##0 \leq y \leq \theta## in the above. For ##y > \theta## we have ##F_Y(y) = 1##.

Thanks a lot. When I use the technique that you suggested, I get...

P\{ \max(X_1,X_2, \ldots, X_n) \leq y \} = P\{ X_1 \leq y, X_2 \leq y, \ldots, X_n \leq y \} = P(X_1 \leq y)P(X_2 \leq y)...P(X_n \leq y) = (\frac{y^2}{\theta^2})^n

When I use the order statistics (I did it again, because the one I did before was wrong), I get...

f_n(y_n)=\frac{n!}{(n-1)!(n-n)!}[F(y_n)]^{n-1}[1-F(y_n)]^{n-n}f(y_n)

= n(F(y_n))^{n-1}f(y_n)= n(\frac{{y_n}^2}{\theta^2})^n(\frac{\theta^2}{y_n})(\frac{2y_n}{\theta^2}) =(\frac{2n}{y_n})(\frac{{y_n}^2}{\theta^2})^n

This question is also solved in this link (question 2):

http://www.math.harvard.edu/~phorn/362/362assn6-solns.pdf

All three of these answers are different. I keep repeating this to see if I did something wrong, but I just keep getting the same answers. It's really frustrating...
 
Last edited by a moderator:

Similar threads

  • · Replies 2 ·
Replies
2
Views
1K
  • · Replies 14 ·
Replies
14
Views
2K
  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 8 ·
Replies
8
Views
2K
Replies
3
Views
3K
  • · Replies 11 ·
Replies
11
Views
2K
Replies
11
Views
2K
  • · Replies 2 ·
Replies
2
Views
1K
  • · Replies 7 ·
Replies
7
Views
2K