Posterior Distribution for Number for Grouped Poissons

  • Thread starter Thread starter SpringPhysics
  • Start date Start date
  • Tags Tags
    Distribution
Click For Summary

Homework Help Overview

The discussion revolves around determining the posterior distribution of a variable N, which is derived from a sequence of n independent Poisson random variables. The first N variables are drawn from a Poisson distribution with parameter a1, while the subsequent variables are drawn from a different Poisson distribution with parameter a2. The prior distribution for N is uniform over the integers from 1 to n-1.

Discussion Character

  • Exploratory, Conceptual clarification, Mathematical reasoning

Approaches and Questions Raised

  • Participants explore the likelihood function and its relationship to the posterior distribution. There are attempts to rearrange terms and questions about the nature of the observations that inform the posterior distribution. Some participants discuss the implications of the sequence of random variables on the estimation of N.

Discussion Status

Participants are actively engaging with the problem, with some expressing clarity about the relative probabilities involved. There is an acknowledgment of the need to normalize these probabilities, and discussions are ongoing regarding the identification of the distribution for further analysis, such as Gibbs sampling.

Contextual Notes

There is a mention of the discrete nature of N and the constraints imposed by the uniform prior distribution. Some participants question the assumptions regarding the observations and their implications for the posterior distribution.

SpringPhysics
Messages
104
Reaction score
0

Homework Statement


I am trying to determine the posterior distribution of N where given a sequence of n independence Poisson random variables, the first N come from Poisson(a1) and the next N+1st to the nth ones come from Poisson(a2). The prior distribution on N is discrete uniform on the integers from 1 to n-1.


Homework Equations





The Attempt at a Solution


I found the likelihood (which is the same as the posterior):

P(N|a1, a2) \alpha e-N(a1-a2)(a1/a2)ƩXi where i goes from 1 to N

No matter how much I try to rearrange the terms, I can't find out what this distribution is. Any help would be appreciated. Thanks.
 
Physics news on Phys.org
SpringPhysics said:

Homework Statement


I am trying to determine the posterior distribution of N where given a sequence of n independence Poisson random variables, the first N come from Poisson(a1) and the next N+1st to the nth ones come from Poisson(a2). The prior distribution on N is discrete uniform on the integers from 1 to n-1.


Homework Equations





The Attempt at a Solution


I found the likelihood (which is the same as the posterior):

P(N|a1, a2) \alpha e-N(a1-a2)(a1/a2)ƩXi where i goes from 1 to N

No matter how much I try to rearrange the terms, I can't find out what this distribution is. Any help would be appreciated. Thanks.

"Posterior" means "after an observation". What is the observation? Is it the sum of the random variables, or what?
 
Ray Vickson said:
"Posterior" means "after an observation". What is the observation? Is it the sum of the random variables, or what?
The way I read the question, though it sounds a little weird, is that a number N is selected according to a distribution, then that number is used to produce a sequence of n terms in which the first N are selected from one Poisson distribution of known parameter, and the rest from a Poisson of known, different parameter. But we don't know what N was. The sequence obtained conveys information about N, so it now has a posterior distribution.
And the way I read the OP, SpringPhysics has figured out the relative probabilities for values of N, but needs to normalise them by dividing by the total. If so, SpringPhysics has done the hard work and it's a simple matter of summing a finite geometric series.
P(N|a1, a2) α e-N(a1-a2)(a1/a2)ƩXi where i goes from 1 to N
Everything is constant in the sum except N.
 
haruspex:
Yes, I've already figured out the relative probabilities. I don't see how this is a sum of a geometric series though. Do you mean to simplify as

exp(Ʃ[Xi * (log(a1) - log(a2)) - (a1 - a2)]}
where the sum goes from i = 1 to N

I still don't recognize the distribution.

EDIT: I understand what you mean now, but I don't need to find the normalizing constant. I need to figure out what this distribution is so that I can perform Gibbs sampling.

EDIT 2: Oh, I see. So I actually have to compute the probability for each possible value of N by dividing the sum, which is actually doable since it's discrete? Thanks so much!
 
Last edited:
SpringPhysics said:
haruspex:
Yes, I've already figured out the relative probabilities. I don't see how this is a sum of a geometric series though. Do you mean to simplify as

exp(Ʃ[Xi * (log(a1) - log(a2)) - (a1 - a2)]}
where the sum goes from i = 1 to N

I still don't recognize the distribution.

EDIT: I understand what you mean now, but I don't need to find the normalizing constant. I need to figure out what this distribution is so that I can perform Gibbs sampling.

EDIT 2: Oh, I see. So I actually have to compute the probability for each possible value of N by dividing the sum, which is actually doable since it's discrete? Thanks so much!
Good job I was offline for a while:smile:
 
  • Like
Likes   Reactions: 1 person

Similar threads

  • · Replies 8 ·
Replies
8
Views
2K
  • · Replies 5 ·
Replies
5
Views
1K
  • · Replies 8 ·
Replies
8
Views
3K
  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 1 ·
Replies
1
Views
1K
  • · Replies 2 ·
Replies
2
Views
3K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 10 ·
Replies
10
Views
2K
  • · Replies 15 ·
Replies
15
Views
2K