Let [tex]\left( {X_n } \right)_{n \ge 0}[/tex] be a Markov chain (discrete time).(adsbygoogle = window.adsbygoogle || []).push({});

I have

[tex]{\bf{P}} = \left[ {pij} \right]_{i,j} = \left[ {P\left( {X_1 = j|X_0 = i} \right)} \right]_{i,j}[/tex],

and the initial probability distribution [tex]{\bf{p}}^{\left( 0 \right)}[/tex].

I need to calculate

[tex]P\left( {\mathop \cup \limits_{i = 0}^8 X_i = 3} \right)[/tex]

I can use Matlab for the numerical calculations but I need to find an expression for this probability. The only expression I have been able to find consists of too many terms to be considered reasonable.

Any suggestions on how to find an expression, that at least in some way is repetitive so that the numerical calculations can be done by the computer, would be appreciated.

**Physics Forums | Science Articles, Homework Help, Discussion**

Join Physics Forums Today!

The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

# Markov chain

**Physics Forums | Science Articles, Homework Help, Discussion**