Markov Processes: Estimating Transition Probabilities

  • Context: Undergrad 
  • Thread starter Thread starter WWGD
  • Start date Start date
  • Tags Tags
    Transition
Join the discussion
Ask a follow-up here, or get your own question answered by working scientists, mathematicians and engineers — people, not an autocomplete.
Real named experts · corrections over time · the nuance an AI answer skips
6 replies · 3K views
Physics news on Phys.org
Are there several options? Im not aware on what area /aspect to sample.I think , yes, iirc, they applied MLE to sample data, but I couldn't come up with the actual statistic .
 
Last edited:
FactChecker said:
Based on what? Do you have sample data of single-step transitions?
Edit: Sample proportions; number of times there has been a transition between states i and j, divided by total number of transitions/states ( for the discrete case)s, or anything else that's available for the continuous case .
 
Last edited:
WWGD said:
Edit: Sample proportions; number of times there has been a transition between states i and j, divided by total number of transitions/states ( for the discrete case)s, or anything else that's available for the continuous case .
I would divide by the number of samples that were in state i before the single step. Also, j=i should be included.
 
Reply
  • Like
Likes   Reactions: WWGD