Exponential of (Markov Chain) Transition matrix

Click For Summary
The discussion centers on the properties of a Markov chain transition matrix, X, and its generator, Y, which is derived from X. It is noted that while X's rows sum to 1, the sums of Y must equal 0, prompting a query about the reasoning behind this requirement. The conversation explores the matrix exponential and its power series representation, emphasizing that contributions from terms beyond the identity matrix must also sum to zero. Additionally, the participants discuss methods for raising matrices to non-integer powers, confirming that the logarithmic and exponential relationships hold in these cases. The thread concludes with affirmations of the discussed concepts, reinforcing the mathematical principles involved.
NewStudent200
Messages
5
Reaction score
0
Hi,

I have a (markov chain) transition matrix X which I understand. In particular each row of this matrix sums to 1.

I have used this transition matrix to construct it's generator, Y. I.e. Y is the continuously compounded transition matrix,

X = exp(Y)
X*X = exp(2Y), etc

both X and Y are matrices.

I am told that the sums of Y must sum to 0, but I can not see why this should be the case. Is it obvious?

Many Thanks.
 
Physics news on Phys.org
Possible hint maybe? e^0=1
 
Thanks.

But I have trouble visualizing this for a matrix. Is there aproof somewhere, or a text that you can recommend which gives examples and talks about the applications of taking exponentials or logs of matrices?

Many thanks,
 
It is a http://en.wikipedia.org/wiki/Matrix_exponential" right ? If you write down the power series for it you will get a pattern.

<br /> X = I + Y + \frac{Y^2}{2!} + \ldots<br />
Now if you sum up the rows of X it is 1. On the right hand side you already get 1 from the identity matrix. So all contributions from the remaining terms must be zero right? So I will let you think if your condition is sufficient or necessary.
 
Last edited by a moderator:
Cool. Thanks a lot!

Thinking about matrices a little further. How does one raise a matrix to a decimal power. I know that in the case of an integer power:

X^n = S.M^n.S^-1

where S is the eigen vector matrix and M is the matrix with eigen values along the diagonal. Now if n is non integer, then does this still hold? Could we also do it via:

Y = X^n
ln(Y) = n.ln(X)
Y = exp(n.ln(X))?

much appreciated.
 
NewStudent200 said:
Cool. Thanks a lot!

Thinking about matrices a little further. How does one raise a matrix to a decimal power. I know that in the case of an integer power:

X^n = S.M^n.S^-1

where S is the eigen vector matrix and M is the matrix with eigen values along the diagonal. Now if n is non integer, then does this still hold? Could we also do it via:

Y = X^n
ln(Y) = n.ln(X)
Y = exp(n.ln(X))?

much appreciated.

yes, yes

also:
if X = S M S^{-1} then e^X = S e^M S^{-1}, \log(X) = S \log(M) S^{-1}, etc.
 
Thread 'How to define a vector field?'
Hello! In one book I saw that function ##V## of 3 variables ##V_x, V_y, V_z## (vector field in 3D) can be decomposed in a Taylor series without higher-order terms (partial derivative of second power and higher) at point ##(0,0,0)## such way: I think so: higher-order terms can be neglected because partial derivative of second power and higher are equal to 0. Is this true? And how to define vector field correctly for this case? (In the book I found nothing and my attempt was wrong...

Similar threads

  • · Replies 24 ·
Replies
24
Views
2K
  • · Replies 12 ·
Replies
12
Views
2K
Replies
24
Views
4K
  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 12 ·
Replies
12
Views
5K
  • · Replies 8 ·
Replies
8
Views
3K
  • · Replies 1 ·
Replies
1
Views
3K
Replies
3
Views
2K
  • · Replies 93 ·
4
Replies
93
Views
7K