Transience of MC: Proving b>=1

  • Thread starter Thread starter alphabeta1989
  • Start date Start date
alphabeta1989
Messages
3
Reaction score
0
1. Homework Statement
Consider the following model.

X_{n+1} given X_n, X_{n-1},...,X_0 has a Poisson distribution with mean \lambda=a+bX_n where a>0,b\geq{0}. Show that X=(X_n)_{n\in\mathrm{N_0}} is a transient M.C if b\geq 1.2. Homework Equations

How do we approach this question? I was thinking of using the theorem below.

Let X be an irreducible Markov chain with countable state space S. A necessary and sufficient condition for X to be transient is the existence of a non-constant, non-negative super-harmonic function \phi.
3. The Attempt at a Solution
I was thinking of using an exponential function as a superharmonic function, but failed terribly. What superharmonic function can we use to prove transcience for b\geq 1 Thanks in advance.
 
Last edited:
Physics news on Phys.org
alphabeta1989 said:
1. Homework Statement
Consider the following model.

X_{n+1} given X_n, X_{n-1},...,X_0 has a Poisson distribution with mean \lambda=a+bX_n where a>0,b\geq{0}. Show that X=(X_n)_{n\in\mathrm{N_0}} is a transient M.C if b\geq 1.


2. Homework Equations

How do we approach this question? I was thinking of using the theorem below.

Let X be an irreducible Markov chain with countable state space S. A necessary and sufficient condition for X to be transient is the existence of a non-constant, non-negative super-harmonic function \phi.



3. The Attempt at a Solution
I was thinking of using an exponential function as a superharmonic function, but failed terribly. What superharmonic function can we use to prove transcience for b\geq 1 Thanks in advance.

Something is missing: you have included no statement about what happens to/with the super-harmonic function ##\phi## in the context of ##X##.
 
Ray Vickson said:
Something is missing: you have included no statement about what happens to/with the super-harmonic function ##\phi## in the context of ##X##.

I attempted to use functions such as \phi(x) = e^{bx}, e^{(b-1)x}, but all of them are not superharmonic w.r.t X. What type of functions should I attempt?
 
alphabeta1989 said:
I attempted to use functions such as \phi(x) = e^{bx}, e^{(b-1)x}, but all of them are not superharmonic w.r.t X. What type of functions should I attempt?

You are missing the whole point: WHAT is supposed to happen if I give you a superharmonic function? You quoted only half of a theorem; the other half is vital!
 
Ray Vickson said:
You are missing the whole point: WHAT is supposed to happen if I give you a superharmonic function? You quoted only half of a theorem; the other half is vital!

I am sorry about that! This is the definition of a superharmonic function!

Let X be a time-homogeneous irreducible Markov chain with countable state space S and one-step transition probability matrix P(x, y). A function \phi: S \rightarrow R is said to be superharmonic for X at x \in S if \sum_{y\in S} P(x,y)\phi(y)\leq\phi(x)
 
alphabeta1989 said:
I am sorry about that! This is the definition of a superharmonic function!

Let X be a time-homogeneous irreducible Markov chain with countable state space S and one-step transition probability matrix P(x, y). A function \phi: S \rightarrow R is said to be superharmonic for X at x \in S if \sum_{y\in S} P(x,y)\phi(y)\leq\phi(x)

If you don't care about signs, just getting a superharmonic ##\phi## is easy: in this case, ##\phi(x) = -x## is superharmonic if ##a>0,\: b \geq 1##. However, if you want a non-negative ##\phi## it is harder. You can follow the construction in
http://math.stackexchange.com/questions/165913/markov-chains-recurrence-and-transcience
 
Prove $$\int\limits_0^{\sqrt2/4}\frac{1}{\sqrt{x-x^2}}\arcsin\sqrt{\frac{(x-1)\left(x-1+x\sqrt{9-16x}\right)}{1-2x}} \, \mathrm dx = \frac{\pi^2}{8}.$$ Let $$I = \int\limits_0^{\sqrt 2 / 4}\frac{1}{\sqrt{x-x^2}}\arcsin\sqrt{\frac{(x-1)\left(x-1+x\sqrt{9-16x}\right)}{1-2x}} \, \mathrm dx. \tag{1}$$ The representation integral of ##\arcsin## is $$\arcsin u = \int\limits_{0}^{1} \frac{\mathrm dt}{\sqrt{1-t^2}}, \qquad 0 \leqslant u \leqslant 1.$$ Plugging identity above into ##(1)## with ##u...
Back
Top