Exponential of (Markov Chain) Transition matrix

Click For Summary

Discussion Overview

The discussion revolves around the properties and implications of the exponential of a Markov chain transition matrix and its generator. Participants explore the mathematical foundations of these concepts, including the conditions under which the sums of the generator matrix must equal zero and the methods for raising matrices to non-integer powers.

Discussion Character

  • Technical explanation
  • Mathematical reasoning
  • Debate/contested

Main Points Raised

  • One participant notes that the transition matrix X sums to 1 for each row and questions why the sums of the generator matrix Y must sum to 0.
  • Another participant suggests that the identity matrix contributes 1 to the sum of the rows of X, implying that the remaining terms must sum to zero.
  • A participant seeks resources or proofs regarding the properties of matrix exponentials and logarithms.
  • There is a discussion about raising matrices to non-integer powers, with one participant proposing the use of eigenvalue decomposition and logarithmic properties.
  • Another participant confirms the validity of using the exponential and logarithmic relationships for matrices, referencing the eigenvalue decomposition approach.

Areas of Agreement / Disagreement

Participants express uncertainty regarding the necessity of the condition that the sums of Y must equal zero. There is no consensus on the sufficiency of the condition or the implications of raising matrices to non-integer powers.

Contextual Notes

Some participants mention the need for further exploration of matrix exponentials and logarithms, indicating potential gaps in understanding or examples that illustrate these concepts.

NewStudent200
Messages
5
Reaction score
0
Hi,

I have a (markov chain) transition matrix X which I understand. In particular each row of this matrix sums to 1.

I have used this transition matrix to construct it's generator, Y. I.e. Y is the continuously compounded transition matrix,

X = exp(Y)
X*X = exp(2Y), etc

both X and Y are matrices.

I am told that the sums of Y must sum to 0, but I can not see why this should be the case. Is it obvious?

Many Thanks.
 
Physics news on Phys.org
Possible hint maybe? e^0=1
 
Thanks.

But I have trouble visualizing this for a matrix. Is there aproof somewhere, or a text that you can recommend which gives examples and talks about the applications of taking exponentials or logs of matrices?

Many thanks,
 
It is a http://en.wikipedia.org/wiki/Matrix_exponential" right ? If you write down the power series for it you will get a pattern.

<br /> X = I + Y + \frac{Y^2}{2!} + \ldots<br />
Now if you sum up the rows of X it is 1. On the right hand side you already get 1 from the identity matrix. So all contributions from the remaining terms must be zero right? So I will let you think if your condition is sufficient or necessary.
 
Last edited by a moderator:
Cool. Thanks a lot!

Thinking about matrices a little further. How does one raise a matrix to a decimal power. I know that in the case of an integer power:

X^n = S.M^n.S^-1

where S is the eigen vector matrix and M is the matrix with eigen values along the diagonal. Now if n is non integer, then does this still hold? Could we also do it via:

Y = X^n
ln(Y) = n.ln(X)
Y = exp(n.ln(X))?

much appreciated.
 
NewStudent200 said:
Cool. Thanks a lot!

Thinking about matrices a little further. How does one raise a matrix to a decimal power. I know that in the case of an integer power:

X^n = S.M^n.S^-1

where S is the eigen vector matrix and M is the matrix with eigen values along the diagonal. Now if n is non integer, then does this still hold? Could we also do it via:

Y = X^n
ln(Y) = n.ln(X)
Y = exp(n.ln(X))?

much appreciated.

yes, yes

also:
if X = S M S^{-1} then e^X = S e^M S^{-1}, \log(X) = S \log(M) S^{-1}, etc.
 

Similar threads

  • · Replies 12 ·
Replies
12
Views
2K
Replies
24
Views
4K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 12 ·
Replies
12
Views
5K
  • · Replies 5 ·
Replies
5
Views
3K
  • · Replies 8 ·
Replies
8
Views
3K
  • · Replies 1 ·
Replies
1
Views
4K
  • · Replies 17 ·
Replies
17
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 1 ·
Replies
1
Views
3K