Posterior distribution question Pixie's question from Yahoo Answers

  • Context: MHB 
  • Thread starter Thread starter CaptainBlack
  • Start date Start date
  • Tags Tags
    Distribution
Click For Summary
SUMMARY

This discussion focuses on deriving the posterior distribution of the success probability alpha in a Bernoulli trial using Bayesian inference. The prior distribution assigned to alpha is Uniform(0,1). For the first case with one success in one trial, the posterior distribution is calculated as P(alpha|data) = 2α. In the second case, with two successes in five trials, the likelihood function is given by P(data|alpha) = b(2;5,alpha) = (5!/(2!3!))α²(1-α)³, leading to a more complex posterior distribution that requires further integration.

PREREQUISITES
  • Understanding of Bernoulli trials and success probability
  • Familiarity with Bayesian inference and Bayes' theorem
  • Knowledge of prior distributions, specifically Uniform distributions
  • Basic calculus for integration and probability density functions
NEXT STEPS
  • Study the derivation of posterior distributions in Bayesian statistics
  • Learn about different prior distributions and their impacts on posterior results
  • Explore the concept of likelihood functions in statistical modeling
  • Investigate the use of Markov Chain Monte Carlo (MCMC) methods for posterior estimation
USEFUL FOR

Statisticians, data scientists, and anyone interested in Bayesian analysis and the application of probability theory in real-world scenarios.

CaptainBlack
Messages
801
Reaction score
0
Reposted from Yahoo Answers:

Suppose that Yi is the result of a Bernoulli trial, with probability alpha of success (Yi=1).
If we assign a Unif(0,1) prior distribution to alpha, find the posterior distribution of alpha after the observations:
(a) 1
(b) 0, 1, 1, 0, 0

Thank you so much if you can help! :)
 
Physics news on Phys.org
CaptainBlack said:
Reposted from Yahoo Answers:

Suppose that Yi is the result of a Bernoulli trial, with probability alpha of success (Yi=1).
If we assign a Unif(0,1) prior distribution to alpha, find the posterior distribution of alpha after the observations:
(a) 1
(b) 0, 1, 1, 0, 0

Thank you so much if you can help! :)


From Bayes' theorem we have:\[P(\alpha|data) = \frac{P(data|\alpha)P(\alpha)}{P(data)}\]

For case (a) we have one success in one trial with prob of success \(\alpha\) so:

\(P(data|\alpha)=\alpha \)

\(P(\alpha)=1\) (since the prior for alpha is \(U(0,1)\) its density is \(1\) for \(\alpha\) in \([0,1]\) and zero elswhere)

\( \displaystyle P(data) = \int_{\alpha=0}^1 P(data|\alpha)P(\alpha)\; d \alpha =\int_{\alpha=0}^1 \alpha \; d \alpha =\Bigl[ \alpha^2/2 \Bigr]_0^1=\frac{1}{2} \)

and so:
\[ P(\alpha|data)=2 \alpha\]For case (b) we have 2 successes in 5 trials so:

\( \displaystyle P(data|\alpha)= b(2;5,\alpha)= \frac{5!}{2!\;3! }\alpha^2 (1-\alpha)^3 \)

CB
 

Similar threads

  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 9 ·
Replies
9
Views
2K
  • · Replies 14 ·
Replies
14
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K
Replies
1
Views
4K
Replies
1
Views
3K
  • · Replies 1 ·
Replies
1
Views
2K
Replies
1
Views
2K