Anyone knows about Markov Chains?

  • Thread starter Thread starter nktvnvn
  • Start date Start date
nktvnvn
Messages
6
Reaction score
0
Hi all

Does anyone in this forum have a firm understanding of Markov Chains? I searched for this thing on the Net but could not find very useful information. Most of them are very abstract.

I appreciate it if anyone can please show me an easy-to-follow example to illustrate the purpose of Markov Chains.

Thanks a lot.
 
Physics news on Phys.org
mathworld.com
 

Thread 'Trouble understanding an online solution to an exercise in Dummit & Foote'

##\textbf{Exercise 10}:## I came across the following solution online: Questions: 1. When the author states in "that ring (not sure if he is referring to ##R## or ##R/\mathfrak{p}##, but I am guessing the later) ##x_n x_{n+1}=0## for all odd $n$ and ##x_{n+1}## is invertible, so that ##x_n=0##" 2. How does ##x_nx_{n+1}=0## implies that ##x_{n+1}## is invertible and ##x_n=0##. I mean if the quotient ring ##R/\mathfrak{p}## is an integral domain, and ##x_{n+1}## is invertible then...
View full post »

Thread 'Questions about non existence of GCDs vs (coimages, cokernels)'

The following are taken from the two sources, 1) from this online page and the book An Introduction to Module Theory by: Ibrahim Assem, Flavio U. Coelho. In the Abelian Categories chapter in the module theory text on page 157, right after presenting IV.2.21 Definition, the authors states "Image and coimage may or may not exist, but if they do, then they are unique up to isomorphism (because so are kernels and cokernels). Also in the reference url page above, the authors present two...
View full post »

Thread '##(A/\mathfrak{a})_{\mathfrak{p}/\mathfrak{a}}## and its isomorphism?'

I asked online questions about Proposition 2.1.1: The answer I got is the following: I have some questions about the answer I got. When the person answering says: ##1.## Is the map ##\mathfrak{q}\mapsto \mathfrak{q} A _\mathfrak{p}## from ##A\setminus \mathfrak{p}\to A_\mathfrak{p}##? But I don't understand what the author meant for the rest of the sentence in mathematical notation: ##2.## In the next statement where the author says: How is ##A\to...
View full post »

Similar threads

A Understanding Markov Chains in Metropolis Monte Carlo Ising Simulation
Replies
5
Views
2K
A Martingale, calculation of probability - Markov chain needed?
Replies
3
Views
2K
I Bell vs Kolmogorov: Unravelling Probability Theory Limits
2
Replies
93
Views
7K
Limit of a continuous time Markov chain
Replies
8
Views
2K
Studying Seeking advice about a quantum mechanics self-study plan
Replies
9
Views
2K
Is this a correct observation about Markov-chains and stoc.processes?
Replies
14
Views
2K
Solving Binary Markov Sources Exercises
Replies
7
Views
2K
Determining the states in Markov chains
Replies
1
Views
1K
Markov Chain aggregation method
Replies
1
Views
2K
Markov Chain - Find the Stationary Distribution
Replies
2
Views
14K

Hot Threads

Recent Insights

Back
Top