MLE of Bivariate Vector Random Variable: Proof & Explanation

squenshl
Messages
468
Reaction score
4

Homework Statement


Consider the bivariate vector random variable ##(X,Y)^T## which has the probability density function $$f_{X,Y}(x,y) = \theta xe^{-x(y+\theta)}, \quad x\geq 0, y\geq 0 \; \; \text{and} \; \; \theta > 0.$$
I have shown that the marginal distribution of ##X## is ##f_X(x|\theta) = \theta e^{-\theta x}, \quad x\geq 0 \; \; \text{and} \; \; \theta > 0.##

My question is why do these two distributions have the same maximum likelihood estimator ##\hat{\theta} = \frac{1}{\bar{x}}??##

Homework Equations

The Attempt at a Solution

 
Physics news on Phys.org
squenshl said:

Homework Statement


Consider the bivariate vector random variable ##(X,Y)^T## which has the probability density function $$f_{X,Y}(x,y) = \theta xe^{-x(y+\theta)}, \quad x\geq 0, y\geq 0 \; \; \text{and} \; \; \theta > 0.$$
I have shown that the marginal distribution of ##X## is ##f_X(x|\theta) = \theta e^{-\theta x}, \quad x\geq 0 \; \; \text{and} \; \; \theta > 0.##

My question is why do these two distributions have the same maximum likelihood estimator ##\hat{\theta} = \frac{1}{\bar{x}}??##

Homework Equations

The Attempt at a Solution

In one case you observe ##(X,Y)=(x,y)## and estimate ##\theta## from ##f_{XY}(x,y)##, which requires finding the maximum of a function of the form ##a \theta e^{-x \theta}##, where ##a = x e^{-xy}## is a number. In the other case you observe ##X=x## and estimate ##\theta## from ##f_X(x)##, which requires finding the maximum of a function of the form ##a \theta e^{-x \theta}##, where ##a = 1##. The "scale factor" ##a## does not affect the optimization.

Put it another way: the MLS estimator of ##\theta##, based on ##f_{XY}(x,y)## is independent of ##y##. Think of ##f_X(x)## as a sum over ##y## of curves ##f_{XY}(x,y)##, where the variable is ##\theta## and ##x, y## are just an input parameters. Each of these constituent curves has a maximum at the same point ##\theta = 1/x##, so the sum over ##y## is maximized at the same point.
 
Last edited:
There are two things I don't understand about this problem. First, when finding the nth root of a number, there should in theory be n solutions. However, the formula produces n+1 roots. Here is how. The first root is simply ##\left(r\right)^{\left(\frac{1}{n}\right)}##. Then you multiply this first root by n additional expressions given by the formula, as you go through k=0,1,...n-1. So you end up with n+1 roots, which cannot be correct. Let me illustrate what I mean. For this...
Back
Top