Maximum likelihood of a statistical model

Click For Summary

Homework Help Overview

The discussion revolves around finding the maximum likelihood estimator for the parameters μ and φ in a statistical model defined by the distribution of the random variables \(Y_i = μ + (1 + φ x_i) + ε_i\), where ε_i are independent and normally distributed errors. Participants are exploring the correct formulation of the likelihood function based on the given model.

Discussion Character

  • Conceptual clarification, Mathematical reasoning, Problem interpretation

Approaches and Questions Raised

  • Participants are attempting to derive the log likelihood function but are questioning the validity of their expressions and whether they are correctly incorporating the sample data. There is confusion about the appropriate form of the likelihood function and the role of the probability density function of the random variable \(Y_i\).

Discussion Status

Some participants are providing guidance on the need to express the likelihood function in terms of the probability density function of \(Y_i\). There is an ongoing exploration of the correct approach to formulating the likelihood based on the distribution of the errors and the relationship defined in the model.

Contextual Notes

Participants are grappling with the implications of the normal distribution of the errors and how it affects the formulation of the likelihood function. There is a lack of consensus on the correct expression for the likelihood function, and some participants are emphasizing the importance of starting from the basics of probability density functions.

the_dane
Messages
29
Reaction score
0

Homework Statement


I look at the distribution ##(Y_1,Y_2,...,Y_n)##
where
##Y_i=μ+(1+φ x_i)+ε_i## where ##-1<φ<1## and ##-1<x_i<1## . x's are known numbers. ε's are independent and normally distributed with mean 0 and variance 1.

I need to find the the maximum likelihood estimator for μ and φ

Homework Equations

The Attempt at a Solution


I get to the Log likelihood funcion: ##L(Y_1,Y_2,...,Y_n;μ,φ)=∑μ+(1+φ x_i)+ε_i##
When I differentiate it get:
##d L / dμ =∑1/(μ+(1+φ x_i)+ε_i), d L / dφ =∑x/(μ+(1+φ x_i)+ε_i##. Right?
These equations doesn't allow me to set ##d L / dμ=0,d L / dφ=0## because you can't divide by zero. What is going wrong for me?
 
Physics news on Phys.org
the_dane said:
I get to the Log likelihood funcion: ##L(Y_1,Y_2,...,Y_n;μ,φ)=∑μ+(1+φ x_i)+ε_i##

Before you get to the log liklihood function, what function are you using for the liklihood function?
if the ##Y_i## represent the sample data, the expression for the liklihood function should have the variables ##Y_i## in it. Otherwise, you'd be doing a computation that ignores the data.
 
the_dane said:

Homework Statement


I look at the distribution ##(Y_1,Y_2,...,Y_n)##
where
##Y_i=μ+(1+φ x_i)+ε_i## where ##-1<φ<1## and ##-1<x_i<1## . x's are known numbers. ε's are independent and normally distributed with mean 0 and variance 1.

I need to find the the maximum likelihood estimator for μ and φ

Homework Equations

The Attempt at a Solution


I get to the Log likelihood funcion: ##L(Y_1,Y_2,...,Y_n;μ,φ)=∑μ+(1+φ x_i)+ε_i##
When I differentiate it get:
##d L / dμ =∑1/(μ+(1+φ x_i)+ε_i), d L / dφ =∑x/(μ+(1+φ x_i)+ε_i##. Right?
These equations doesn't allow me to set ##d L / dμ=0,d L / dφ=0## because you can't divide by zero. What is going wrong for me?

This does not look like any likelihood function I have ever seen.

Start with the basics: what is the probability density ##f_i(y)## of the random variable ##Y_i##, that is, what is the function ##f_i(y)## in the statement ##P(y < Y_i < y + dy) = f_i(y)\, dy ?## In terms of the density functions ##f_1(y_1), f_2(y_2), \ldots, f_n(y_n)##, what is the likelihood of an observed event ##\{ Y_1 = y_1, Y_2 =y_2, \ldots, Y_n = y_n\}?## For given ##\{y_i\}## you want to maximize that likelihood function.
 
Stephen Tashi said:
Before you get to the log liklihood function, what function are you using for the liklihood function?
if the ##Y_i## represent the sample data, the expression for the liklihood function should have the variables ##Y_i## in it. Otherwise, you'd be doing a computation that ignores the data.
I use ##L(Y_1,...Y_n;μ,φ) =Y_1*Y_2*...*Y_n##
 
the_dane said:
I use ##L(Y_1,...Y_n;μ,φ) =Y_1*Y_2*...*Y_n##

That isn't correct. The problem does not say that ##Y_i## is a random variable with an exponential distribution. The problem says that ##\epsilon_i## is a random variable with a normal distribution.

The only random variable with a known distribution in the equation ##Y_i = \mu + (1 + \phi x_i) + \epsilon_i## is the variable ##\epsilon_i##.

The liklihood that ##\epsilon_i = \alpha_i## is ##\frac{1}{\sqrt{2\pi}} e^{- \frac{\alpha_i^2}{2}} ##

Solve the equation ##Y_i = \mu + (1 + \phi x_i) + \alpha_i ## for ##\alpha_i## to express that liklihood in terms of ##Y_i##.
 
the_dane said:
I use ##L(Y_1,...Y_n;μ,φ) =Y_1*Y_2*...*Y_n##

No: you do not multiply the random variables together; if anything, you multiply their probability distributions.

So, to return to my question in #3: what is (a formula for) the probability density function ##f_i(y)## of the random variable ##Y_i?##. Until you can answer that question you will get absolutely nowhere with this problem!
 
Ray Vickson said:
No: you do not multiply the random variables together; if anything, you multiply their probability distributions.

So, to return to my question in #3: what is (a formula for) the probability density function ##f_i(y)## of the random variable ##Y_i?##. Until you can answer that question you will get absolutely nowhere with this problem!
Can I get the prob. distribution from the formula of ##Y_i##.
 
the_dane said:
Can I get the prob. distribution from the formula of ##Y_i##.

Yes, that is exactly what you need to do.
 

Similar threads

  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 3 ·
Replies
3
Views
3K
Replies
1
Views
4K
  • · Replies 30 ·
2
Replies
30
Views
4K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 2 ·
Replies
2
Views
1K