MHB Need help with probability question. probability of dependent events.

Click For Summary
To calculate the probability of landing on each level in a scenario involving dependent events, a finite state Markov chain is the appropriate method. The levels range from -n to n, with specific transition probabilities influencing movement between levels. When reaching the boundaries, the process resets to level 0, complicating the calculations slightly. The steady state probability distribution can be determined by solving for the eigenvector of the transition matrix. This approach will yield the desired percentages for each level in an infinite run of the process.
Mewlove
Messages
1
Reaction score
0
Would like to know what method, or distribution to use when solving a problem like this:I start from level 0. There is a probability p chance to drop to level -1 and a (1-p) chance to increase to level 1.

The levels range from level -n to level n. When it reaches level -n or level n, it resets back to 0 on the same cycle.
(Also, if you are at level -1, there is (1-p) chance to go back to level 0)

How do I calculate the percentage of landing on each level (not counting the reset), assuming I continue running this infinitely? Seems like dependent events. Is there any theorem or formula I can use?

Thanks!
 
Last edited:
Physics news on Phys.org
what you're looking for here is a finite state (recurrent, time homogenous) markov chain. Depending on whether your n is even or odd, the chain may actually be periodic with period 2 but that is a minor complication-- you want to solve for the eigenvector that gives a steady state probability distribution.

the key thing to search for is 'finite state markov chain'
 
There is a nice little variation of the problem. The host says, after you have chosen the door, that you can change your guess, but to sweeten the deal, he says you can choose the two other doors, if you wish. This proposition is a no brainer, however before you are quick enough to accept it, the host opens one of the two doors and it is empty. In this version you really want to change your pick, but at the same time ask yourself is the host impartial and does that change anything. The host...

Similar threads

  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 13 ·
Replies
13
Views
2K
Replies
29
Views
4K
  • · Replies 5 ·
Replies
5
Views
3K
  • · Replies 7 ·
Replies
7
Views
563
  • · Replies 3 ·
Replies
3
Views
2K
Replies
4
Views
2K
  • · Replies 6 ·
Replies
6
Views
3K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K