How Can You Prove a Process is Markovian?

  • Context: Graduate 
  • Thread starter Thread starter znbhckcs
  • Start date Start date
  • Tags Tags
    Process
Join the discussion
Ask a follow-up here, or get your own question answered by working scientists, mathematicians and engineers — people, not an autocomplete.
Real named experts · corrections over time · the nuance an AI answer skips
1 reply · 2K views
znbhckcs
Messages
14
Reaction score
0
Hi
In Van Kampen's "Stochastic Processes in Physics" it says (page 79) that any given 2 non negative functions: p1(y,t), p11(y1,t1 | y2,t2) that satisfy:
1. The Chapman-Kolmogorov equation: p11(y3,t3 | t1,t1) = integrate(p11(y3,t3 |y2,t2) p11(y2,t2| y1,t1).
2. p1(y2,t2)= Integrate(p11(y2,t2 |y1,t1) p1(y1,t1)dy1
define uniquely a Markov process. But unfortunately it doesn't provide a proof.

My question is, how can you prove it? I have been trying to find a way to get to the next probability function p12(y1,t1 | y2,t2 , y3,t3) in order to show the Markov property exists, and I just can't find a way to do it.

Thanks
 
Physics news on Phys.org
Compare the distribution functions : they're multiplicative in the equations you've quoted . Thus, the independence of probabilities over time means that the processes are
'forgetful' or Markov.
For a complete proof, verify that the equations define a markov process in the discrete case. One can then pass over to step functions & to measurable functions.