Discussion Overview
The discussion revolves around characterizing the probability distribution of the number of visits to state 2 in an irreducible and positive recurrent Markov chain after two consecutive visits to state 1. Participants explore the formulation of this probability in the context of stationary probabilities.
Discussion Character
- Exploratory
- Mathematical reasoning
Main Points Raised
- One participant suggests writing out the possible sequences of visits to states 1 and 2 to derive a formula for the probability distribution.
- Another participant expresses uncertainty about how to formulate the probabilities for the sequences, providing specific examples and calculations for certain sequences.
- A third participant proposes that the probabilities should be multiplied by the stationary probabilities of states 1 and 2, depending on the transitions, but is unsure about a general equation for all cases.
- A later reply references a paper that discusses the unconditional distribution of successes in trials, suggesting that a similar approach may be needed for the conditional distribution based on the visits to state 1.
Areas of Agreement / Disagreement
Participants do not reach a consensus on a general formula for the probability distribution, and there are multiple competing approaches and uncertainties expressed throughout the discussion.
Contextual Notes
Participants note the dependence on the definitions of the states and the transitions, as well as the need for a clearer understanding of the conditions under which the probabilities are calculated.