Finding the Maximum Likelihood Estimate for Theta in a Random Sample of Size 8.

  • Thread starter Thread starter semidevil
  • Start date Start date
  • Tags Tags
    Mle
Click For Summary
SUMMARY

The discussion focuses on finding the Maximum Likelihood Estimate (MLE) for the parameter theta in a random sample of size 8, where the sample consists of binary outcomes (0s and 1s). The likelihood function is defined as p(k;theta) = theta^k * (1 - theta)^(1 - k), with k representing the number of successes. The user correctly identifies the need to take the natural logarithm of the likelihood function and differentiate it to derive the MLE, but requires clarification on the role of the sample and the parameters involved.

PREREQUISITES
  • Understanding of Maximum Likelihood Estimation (MLE)
  • Familiarity with binary probability distributions
  • Knowledge of differentiation and logarithmic functions
  • Basic statistics concepts, including random sampling
NEXT STEPS
  • Study the derivation of the MLE for binary distributions
  • Learn about the role of sample size in MLE calculations
  • Explore the implications of different parameter estimates in statistical modeling
  • Review examples of MLE applications in real-world scenarios
USEFUL FOR

Statisticians, data analysts, and students preparing for exams in statistical estimation methods, particularly those focusing on Maximum Likelihood Estimation.

semidevil
Messages
156
Reaction score
2
I have a big test coming up, regarding estimators, but I just can't figure out the basics of maximum likilieehood.



so given this example, is this right?

p(k;theta) = theta^k * (1 - theta)^(1 - k), k = 0 1, and 0 < theta < 1.

so it's just the product of the function, and I get:

theta^K * 1 - (theta)^(sum from 1 to n of (k - n)).

then I take the natural log, and differentiate it to get

k/theta + (k - n)/ (1 - theta) = 0.

now, all I need to do is to put it in terms of theta...


first, did I do the first part right? in terms of finding the likelihoo function?

there's a lot of variables and I get confused when I do the products
 
Physics news on Phys.org
It's hard to say- you haven't told us what n is or what k and theta are. Which is the parameter? Or are you doing a maximum likelihood estimate for both parameters at the same time?

In particular, I don't see any mention of a SAMPLE. The maximum likelyhood estimate for a parameter(s), given a SAMPLE, is the value of the parameter(s) that makes the probability of getting that particular sample largest.
 
HallsofIvy said:
It's hard to say- you haven't told us what n is or what k and theta are. Which is the parameter? Or are you doing a maximum likelihood estimate for both parameters at the same time?

In particular, I don't see any mention of a SAMPLE. The maximum likelyhood estimate for a parameter(s), given a SAMPLE, is the value of the parameter(s) that makes the probability of getting that particular sample largest.


sorry...ok, so this is a random sample of size 8 w/ x1 = 1, x2 = 0, x3 = 1, x4 = 1, x5 = 0, x6 =1, x7 = 1, and x8 = 0.

I need to find the MLE for theta.
 

Similar threads

  • · Replies 11 ·
Replies
11
Views
2K
Replies
8
Views
2K
Replies
2
Views
2K
  • · Replies 7 ·
Replies
7
Views
2K
Replies
1
Views
2K
Replies
46
Views
8K
Replies
21
Views
3K
  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 4 ·
Replies
4
Views
3K