Markov Chain as a function of dimensions

Join the discussion
Ask a follow-up here, or get your own question answered by working scientists, mathematicians and engineers — people, not an autocomplete.
Real named experts · corrections over time · the nuance an AI answer skips
1 reply · 2K views
FallenApple
Messages
564
Reaction score
61


Here is an animation I created in R.

I built this Markov chain of order 50 by correlating the information in one of the coordinates while randomly varying the rest. Is there an explanation for the clustering and flattening out over increasing dimensions of the vector space? Is it due to the fact that data becomes spread out over larger dimensions?

But that doesn't explain why the clusters themselves do not spread out or why other clusters condense. I've done this for much larger dimensions and it seems to reach a steady state.

The plot is of the incremental changes in a Euclidean metric vs the input, so I don't know if viewing the data as extremely spread out in higher dimensional space would translate to this plot.

Do this mean that the correlation that I induced in that coordinate is strong enough such that it keeps the cluster together regardless of how high the dimension is?
 
Last edited:
Physics news on Phys.org
I'm not sure if this would answer your question, but statisticians Gareth Roberts (of Lancaster University, later University of Warwick, UK) and Jeff Rosenthal (of the University of Toronto, and a former professor of mine when I was in grad school) wrote a paper summarizing limit theorems for Markov Chains in the context of MCMC algorithms.

https://arxiv.org/abs/math/0404033

I believe the contents of the paper will explain the specific convergence of Markov Chains and the properties of "mixing" in Markov Chains (aka the time when Markov Chains are "close" to its steady state distribution).
 
  • Like
Likes   Reactions: FallenApple