Conditional Probability - Markov chain

Click For Summary
SUMMARY

The discussion centers on the conditional distribution in Markov chains, specifically the notation p(x_n|x_{n-1}) and its parameters. It is established that for K states of x_{n-1}, K-1 parameters are required to define the conditional probabilities, as the sum of these probabilities must equal 1. This implies that knowing K-1 parameters allows for the calculation of the K-th parameter, ensuring the total probability remains valid. The conversation clarifies the relationship between the number of states and the parameters needed for accurate representation of conditional probabilities.

PREREQUISITES
  • Understanding of Markov chains and their properties
  • Familiarity with conditional probability concepts
  • Knowledge of discrete random variables
  • Basic grasp of probability theory and summation rules
NEXT STEPS
  • Study the mathematical foundations of Markov chains
  • Explore the concept of conditional independence in probability
  • Learn about the transition matrix in Markov processes
  • Investigate applications of Markov chains in machine learning
USEFUL FOR

Students of probability theory, data scientists, and researchers interested in stochastic processes and their applications in various fields.

Apteronotus
Messages
201
Reaction score
0
Hi,

I was reading about Markov chains and came across the following statement:

"The conditional distribution p(x_n|x_{n-1}) will be specified by a set of K-1 parameters for each of the K states of x_{n-1} giving a total of K(K-1) parameters."

In the above we have assumed that the observations are discrete variables having K states.

I understand that x_{n-1} can have K states, but why K-1 parameters for each state? And what are those parameters?

Thanks,
 
Physics news on Phys.org
There are K different probabilities in the set of values p(x_n|x_{n-1}) and you could call each of these numbers a parameter. Since these probabilities must sum to 1, you only have to specify K-1 of them and this will determine the value of "the last one".
 
Brilliant!

Thank you.
 

Similar threads

  • · Replies 5 ·
Replies
5
Views
1K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 1 ·
Replies
1
Views
1K
  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 29 ·
Replies
29
Views
4K
  • · Replies 4 ·
Replies
4
Views
2K