Question on Discrete Parameter Markov Chains

  • Thread starter AD
  • Start date
  • #1
AD
72
0
I am required to find a formula expressing the probability of return to some state in a Markov chain at time n in terms of the probability of return to that state at time n - k and the probability of first return at time k. I cannot find this in my notes, and I have tried looking at several online resources. Can anyone help me?
 

Answers and Replies

  • #2
AD
72
0
It is no longer necessary for you to answer this question as I have just discovered the answer elsewhere.
 
  • #3
Hurkyl
Staff Emeritus
Science Advisor
Gold Member
14,916
19
You could just derive it. How many ways can you return at time n?

One way is to have time n be the first time you return.
A second way is to return at time 1, and then have n be the next time you return.
Yet another way is to return at time 2, and then have n be the next time you return...
 

Related Threads on Question on Discrete Parameter Markov Chains

  • Last Post
Replies
0
Views
938
  • Last Post
Replies
5
Views
940
Replies
0
Views
4K
  • Last Post
Replies
2
Views
1K
Replies
1
Views
1K
  • Last Post
Replies
0
Views
2K
  • Last Post
Replies
0
Views
2K
  • Last Post
Replies
9
Views
4K
  • Last Post
Replies
1
Views
622
  • Last Post
Replies
1
Views
2K
Top