Proving a process is Markovian

  • Thread starter znbhckcs
  • Start date
  • Tags
    Process
  • #1
14
0
Hi
In Van Kampen's "Stochastic Processes in Physics" it says (page 79) that any given 2 non negative functions: p1(y,t), p11(y1,t1 | y2,t2) that satisfy:
1. The Chapman-Kolmogorov equation: p11(y3,t3 | t1,t1) = integrate(p11(y3,t3 |y2,t2) p11(y2,t2| y1,t1).
2. p1(y2,t2)= Integrate(p11(y2,t2 |y1,t1) p1(y1,t1)dy1
define uniquely a Markov process. But unfortunately it doesn't provide a proof.

My question is, how can you prove it? I have been trying to find a way to get to the next probablity function p12(y1,t1 | y2,t2 , y3,t3) in order to show the Markov property exists, and I just can't find a way to do it.

Thanks
 
  • #2
Compare the distribution functions : they're multiplicative in the equations you've quoted . Thus, the independence of probabilities over time means that the processes are
'forgetful' or Markov.
For a complete proof, verify that the equations define a markov process in the discrete case. One can then pass over to step functions & to measurable functions.
 

Suggested for: Proving a process is Markovian

Replies
2
Views
829
Replies
14
Views
1K
Replies
3
Views
2K
Replies
8
Views
2K
Replies
6
Views
821
Back
Top