Poisson Martingales and Gambler's Ruin

  • Context: Graduate 
  • Thread starter Thread starter RedZone2k2
  • Start date Start date
  • Tags Tags
    Poisson
Click For Summary

Discussion Overview

The discussion centers on finding the probability of an outcome in the Gambler's Ruin problem using a Poisson martingale framework. Participants explore the implications of martingale properties and stopping times in relation to the Poisson process, with a focus on deriving bounds for the probability of winning.

Discussion Character

  • Technical explanation
  • Mathematical reasoning
  • Debate/contested

Main Points Raised

  • One participant outlines the problem setup, defining parameters and the stopping time related to the Gambler's Ruin scenario.
  • Another participant questions the expected value of the martingale, suggesting it should equal the starting amount, while a different participant argues that the expected value is zero, representing net change.
  • A participant points out a potential arithmetic error in the derivation of the probability, suggesting a correction to the equation used.
  • One participant proposes that the optional stopping theorem is necessary to establish the expected value at the stopping time, leading to inequalities that help bound the probability.
  • Another participant acknowledges the role of Poisson jumps in understanding the bounds of the probability, indicating a connection to the nature of the process.

Areas of Agreement / Disagreement

Participants express differing views on the expected value of the martingale and the correct formulation of the probability, indicating that multiple competing interpretations and approaches remain unresolved.

Contextual Notes

There are unresolved mathematical steps regarding the derivation of the bounds for the probability, particularly in relation to the implications of the Poisson process and the nature of jumps in the martingale.

Who May Find This Useful

Readers interested in probability theory, martingales, and stochastic processes, particularly in the context of gambling scenarios and Poisson processes.

RedZone2k2
Messages
8
Reaction score
0
I posted this in the HW help section, but I had no responses. I figure that this place may be better to answer this question. If this is against the rules or anything, mods please remove it!


Homework Statement


Find the probability of an outcome of Gambler's Ruin using a Poisson martingale.

Let m be the parameter of a Poisson Process (ie the lambda)
Let N(t) be a continuous Poisson process at time t>=0
Let M(t) = N(t) - mt

Homework Equations


Now, define s = inf{t | M(t) <= -a or M(t) >= b} (ie the stopping time)
Let r = P(M(s)>=b)

The Attempt at a Solution


I have shown that M(t) is a martingale with E[M(t)] = 0 for all t
Using the martingale principle, I have:
E[M(t)] = 0 = a*(1-r) + b*r
r = a/(a+b).

This is the solution for discrete gambler's ruin. However, my professor says that this value should be an upper bound for r, and the lower bound should be a/(a+b+1) <= r. I'm not sure how to get this.

My guess should be that it has something to do with the Poisson distribution, and the only difference is that b is bigger by 1. But, if there is a Poisson jump at some episilon of time, its just as if we have a+1 dollars, and our opponent has b-1 dollars; hence I should see a change in the numerator of the bound (and not the denominator). Is there any intuition for this? I'm not necessarily just looking for the answer (or equation), but more of understanding why there should be two bounds to my probability.

Thanks!
 
Physics news on Phys.org
Can you describe parameters a and b?
 
Sure,

I think of it like this:

You start out with a dollars, and your opponent starts out with b dollars. The variable M(t) is the sum of all your winnings and losses. You play until one person beats out the other, so you play until M(t) is either -a (where you are bust) or +b (where you bust your opponent). You want to find the probability that you win.
 
If I'm starting out with $a, and M is a martingale, isn't E[M(t)] = E[M(0)] = a for any t > 0 ?
 
M(t) represents the net change from your starting amount, so E[(M(t)] = 0.
 
You're making an arithmetical error: 0 = a*(1 - r) + b*r implies r = a/(a - b), which raises a further issue: a = b implies r = a/0.

[I am guessing you had a typo in the equation, you meant 0 = -a*(1-r) + b*r. That makes sense. See this, where h = a in your problem and N = a + b in your problem. With \alpha = 1/2, you do obtain the symmetrical solution h/N = a/(a+b). However, you'd get a different probability if \alpha\ne 1/2.]
 
Last edited:
Yeah, sorry, that was a typo; what you have written above is correct.
 
See my edits.
 
RedZone2k2 said:
Find the probability of an outcome of Gambler's Ruin using a Poisson martingale.

Let m be the parameter of a Poisson Process (ie the lambda)
Let N(t) be a continuous Poisson process at time t>=0
Let M(t) = N(t) - mt

Now, define s = inf{t | M(t) <= -a or M(t) >= b} (ie the stopping time)
Let r = P(M(s)>=b)

First you'll need the optional stopping theorem to get E[M(s)]=M(0)=0.

Also you know the process first crosses the upper barrier via a jump, or the lower barrier via a non-jump, i.e. M(s)<=-a -> M(s)=a, and M(s)>=b -> M(s)<b+1.

Apply those to E[M(s)] to get two inequalities involving r.

HTH
 
  • #10
I figured it had to do with a Poisson jump. Thanks!
 

Similar threads

  • · Replies 6 ·
Replies
6
Views
3K
  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 8 ·
Replies
8
Views
2K
  • · Replies 7 ·
Replies
7
Views
2K
Replies
8
Views
3K
  • · Replies 0 ·
Replies
0
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 12 ·
Replies
12
Views
5K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 6 ·
Replies
6
Views
4K