We are given two states 1,2 in an irreducible and positive recurrent Markov chain, and their stationary probabilities [tex]\pi_1[/tex] and [tex]\pi_2[/tex] respectively, try to characterise in general the probability (distribution) of the number of visits in state 2 after two consecutive visits in state 1.(adsbygoogle = window.adsbygoogle || []).push({});

Any hints?

**Physics Forums - The Fusion of Science and Community**

Join Physics Forums Today!

The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

# Stationary probabilities.(Markov chain).

Loading...

Similar Threads - Stationary probabilities Markov | Date |
---|---|

I Probability of a Stochastic Markov process | Dec 27, 2017 |

A Help with this problem of stationary distributions | Nov 7, 2017 |

A Stationary probability in Markov | Oct 24, 2016 |

I How do you implement the Dickey-Fuller test? | May 14, 2016 |

Non-stationary distribution of an M/M/infinity queue | Apr 26, 2014 |

**Physics Forums - The Fusion of Science and Community**