Transience of MC: Proving b>=1

  • Thread starter Thread starter alphabeta1989
  • Start date Start date
Click For Summary

Homework Help Overview

The discussion revolves around a Markov chain model where the next state is determined by a Poisson distribution with a mean dependent on the current state. The goal is to demonstrate that the Markov chain is transient when a certain parameter, b, is greater than or equal to 1.2. Participants are exploring the concept of superharmonic functions in relation to this model.

Discussion Character

  • Conceptual clarification, Mathematical reasoning, Assumption checking

Approaches and Questions Raised

  • Participants are considering the use of superharmonic functions to establish transience but are struggling to identify appropriate functions. There is a focus on exponential functions and their properties in the context of the Markov chain.

Discussion Status

Some participants have provided definitions and criteria for superharmonic functions, while others are questioning the completeness of the information shared. There is an ongoing exploration of what characteristics a suitable superharmonic function should have to prove the transience of the Markov chain.

Contextual Notes

Participants note the importance of understanding the implications of superharmonic functions in the context of the Markov chain, as well as the need for non-negative functions to meet the criteria for transience.

alphabeta1989
Messages
3
Reaction score
0
1. Homework Statement
Consider the following model.

[itex]X_{n+1}[/itex] given [itex]X_n, X_{n-1},...,X_0[/itex] has a Poisson distribution with mean [itex]\lambda=a+bX_n[/itex] where [itex]a>0,b\geq{0}[/itex]. Show that [itex]X=(X_n)_{n\in\mathrm{N_0}}[/itex] is a transient M.C if [itex]b\geq 1[/itex].2. Homework Equations

How do we approach this question? I was thinking of using the theorem below.

Let [itex]X[/itex] be an irreducible Markov chain with countable state space [itex]S[/itex]. A necessary and sufficient condition for [itex]X[/itex] to be transient is the existence of a non-constant, non-negative super-harmonic function [itex]\phi[/itex].
3. The Attempt at a Solution
I was thinking of using an exponential function as a superharmonic function, but failed terribly. What superharmonic function can we use to prove transcience for [itex]b\geq 1[/itex] Thanks in advance.
 
Last edited:
Physics news on Phys.org
alphabeta1989 said:
1. Homework Statement
Consider the following model.

[itex]X_{n+1}[/itex] given [itex]X_n, X_{n-1},...,X_0[/itex] has a Poisson distribution with mean [itex]\lambda=a+bX_n[/itex] where [itex]a>0,b\geq{0}[/itex]. Show that [itex]X=(X_n)_{n\in\mathrm{N_0}}[/itex] is a transient M.C if [itex]b\geq 1[/itex].


2. Homework Equations

How do we approach this question? I was thinking of using the theorem below.

Let [itex]X[/itex] be an irreducible Markov chain with countable state space [itex]S[/itex]. A necessary and sufficient condition for [itex]X[/itex] to be transient is the existence of a non-constant, non-negative super-harmonic function [itex]\phi[/itex].



3. The Attempt at a Solution
I was thinking of using an exponential function as a superharmonic function, but failed terribly. What superharmonic function can we use to prove transcience for [itex]b\geq 1[/itex] Thanks in advance.

Something is missing: you have included no statement about what happens to/with the super-harmonic function ##\phi## in the context of ##X##.
 
Ray Vickson said:
Something is missing: you have included no statement about what happens to/with the super-harmonic function ##\phi## in the context of ##X##.

I attempted to use functions such as [itex]\phi(x) = e^{bx}, e^{(b-1)x}[/itex], but all of them are not superharmonic w.r.t [itex]X[/itex]. What type of functions should I attempt?
 
alphabeta1989 said:
I attempted to use functions such as [itex]\phi(x) = e^{bx}, e^{(b-1)x}[/itex], but all of them are not superharmonic w.r.t [itex]X[/itex]. What type of functions should I attempt?

You are missing the whole point: WHAT is supposed to happen if I give you a superharmonic function? You quoted only half of a theorem; the other half is vital!
 
Ray Vickson said:
You are missing the whole point: WHAT is supposed to happen if I give you a superharmonic function? You quoted only half of a theorem; the other half is vital!

I am sorry about that! This is the definition of a superharmonic function!

Let [itex]X[/itex] be a time-homogeneous irreducible Markov chain with countable state space [itex]S[/itex] and one-step transition probability matrix [itex]P(x, y)[/itex]. A function [itex]\phi: S \rightarrow R[/itex] is said to be superharmonic for X at [itex]x \in S[/itex] if [itex]\sum_{y\in S} P(x,y)\phi(y)\leq\phi(x)[/itex]
 
alphabeta1989 said:
I am sorry about that! This is the definition of a superharmonic function!

Let [itex]X[/itex] be a time-homogeneous irreducible Markov chain with countable state space [itex]S[/itex] and one-step transition probability matrix [itex]P(x, y)[/itex]. A function [itex]\phi: S \rightarrow R[/itex] is said to be superharmonic for X at [itex]x \in S[/itex] if [itex]\sum_{y\in S} P(x,y)\phi(y)\leq\phi(x)[/itex]

If you don't care about signs, just getting a superharmonic ##\phi## is easy: in this case, ##\phi(x) = -x## is superharmonic if ##a>0,\: b \geq 1##. However, if you want a non-negative ##\phi## it is harder. You can follow the construction in
http://math.stackexchange.com/questions/165913/markov-chains-recurrence-and-transcience
 

Similar threads

  • · Replies 7 ·
Replies
7
Views
3K
  • · Replies 11 ·
Replies
11
Views
3K
Replies
4
Views
2K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 12 ·
Replies
12
Views
2K
Replies
1
Views
2K
Replies
10
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 9 ·
Replies
9
Views
2K
Replies
2
Views
2K