Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

B Markov model on a sequence of numbers

  1. Feb 16, 2016 #1
    Dear Sir,
    Assuming that my lottery machine can generate 10 numbers (0..9), in which 0 and 9 are supposed to be starting and ending states of my Markov chain. I apply Markov chain to model each number appearance because I would want to modify the random generation process into, say, my own process, such that each currently output number will show up in dependence of the previously generated number.
    Now I would like to run my generator 1000 times and given the probability for any number to reach the end state is x, how can I calculate the sum of probabilities of all integral sequences then ?
    Thank you Sir.
     
  2. jcsd
  3. Feb 16, 2016 #2

    chiro

    User Avatar
    Science Advisor

    Hey iheadset.

    When you say sum of probabilities do you mean the sum of them at each transition point or the sum of events at the final transition?
     
  4. Feb 18, 2016 #3
    Yes, that is right Sir. I would like to find that sum.
     
  5. Feb 19, 2016 #4

    chiro

    User Avatar
    Science Advisor

    That means you are looking at a T + T^2 + T^3 + .... + T^n matrix to find the sum of these transition matrices.

    If you supply an initial probability as your vector and apply it to the above sum there is only one more thing to do - which is to find intersections in events and remove them as they will be "double counted".

    You will probably have to resort to the Markov property to do this and generate identities which you can use to find them.
     
  6. Mar 2, 2016 #5
    'You can try permutation and combinations'. I think it is the easiest method to solve the problem and also you get approximate method. You can try this.
     
Know someone interested in this topic? Share this thread via Reddit, Google+, Twitter, or Facebook

Have something to add?
Draft saved Draft deleted