How Can You Prove a Process is Markovian?

  • Thread starter Thread starter znbhckcs
  • Start date Start date
  • Tags Tags
    Process
Click For Summary
SUMMARY

The discussion centers on proving that two non-negative functions, p1(y,t) and p11(y1,t1 | y2,t2), uniquely define a Markov process as stated in Van Kampen's "Stochastic Processes in Physics." The proof relies on demonstrating that these functions satisfy the Chapman-Kolmogorov equation and the integral condition for marginal distributions. Participants emphasize the importance of verifying the Markov property in the discrete case before generalizing to step functions and measurable functions.

PREREQUISITES
  • Understanding of the Chapman-Kolmogorov equation
  • Familiarity with Markov processes
  • Knowledge of probability distributions
  • Experience with stochastic processes
NEXT STEPS
  • Study the Chapman-Kolmogorov equation in detail
  • Learn about proving properties of Markov processes
  • Explore discrete Markov chains and their properties
  • Investigate step functions and measurable functions in probability theory
USEFUL FOR

Researchers, mathematicians, and students in the fields of probability theory and stochastic processes seeking to deepen their understanding of Markovian properties and proofs.

znbhckcs
Messages
14
Reaction score
0
Hi
In Van Kampen's "Stochastic Processes in Physics" it says (page 79) that any given 2 non negative functions: p1(y,t), p11(y1,t1 | y2,t2) that satisfy:
1. The Chapman-Kolmogorov equation: p11(y3,t3 | t1,t1) = integrate(p11(y3,t3 |y2,t2) p11(y2,t2| y1,t1).
2. p1(y2,t2)= Integrate(p11(y2,t2 |y1,t1) p1(y1,t1)dy1
define uniquely a Markov process. But unfortunately it doesn't provide a proof.

My question is, how can you prove it? I have been trying to find a way to get to the next probability function p12(y1,t1 | y2,t2 , y3,t3) in order to show the Markov property exists, and I just can't find a way to do it.

Thanks
 
Physics news on Phys.org
Compare the distribution functions : they're multiplicative in the equations you've quoted . Thus, the independence of probabilities over time means that the processes are
'forgetful' or Markov.
For a complete proof, verify that the equations define a markov process in the discrete case. One can then pass over to step functions & to measurable functions.
 

Similar threads

Replies
3
Views
4K
Replies
1
Views
8K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 4 ·
Replies
4
Views
4K
  • · Replies 3 ·
Replies
3
Views
8K
Replies
2
Views
3K
Replies
1
Views
5K
  • · Replies 21 ·
Replies
21
Views
4K
  • · Replies 8 ·
Replies
8
Views
9K
Replies
1
Views
7K