Hidden Markov Model Calculation

  • Context: MHB 
  • Thread starter Thread starter betsyrocamora
  • Start date Start date
  • Tags Tags
    Calculation Model
Click For Summary
SUMMARY

The discussion focuses on calculating the probability P(X3=A) in a Hidden Markov Model (HMM) with two states, A and B. The initial probabilities are P(X0=A)=0.6 and P(X0=B)=0.4, with transition probabilities P(X1=A|X0=A)=0.3 and P(X1=B|X0=B)=0.8. Participants suggest using the Chapman-Kolmogorov equations and matrix multiplication to derive the probabilities over time, emphasizing the importance of understanding the Markov property for accurate calculations.

PREREQUISITES
  • Understanding of Hidden Markov Models (HMM)
  • Familiarity with Chapman-Kolmogorov equations
  • Basic knowledge of matrix operations
  • Concept of Markov property in stochastic processes
NEXT STEPS
  • Study the derivation of probabilities in Hidden Markov Models using matrix representation
  • Learn about the Chapman-Kolmogorov equations in detail
  • Explore examples of Markov chains and their applications
  • Investigate software tools for simulating Hidden Markov Models
USEFUL FOR

Students and professionals in data science, statisticians, and anyone interested in probabilistic modeling and machine learning applications involving Hidden Markov Models.

betsyrocamora
Messages
2
Reaction score
0
Can someone help me with this question.

Let us define a Markov hidden model with 2-states A and B, such that

P(X0=A)=0.6,P(X0=B)=0.4,P(X1=A/X0=A)=0.3,P(X1=B/X0=B)=0.8

what is the value of P(X3=A) ??
 
Last edited:
Physics news on Phys.org
Hello betsyrocamora,

Welcome to MHB! (Wave)

Can you show what you have tried and where you are stuck so our helpers have a better idea how best to help you?
 
betsyrocamora said:
Can someone help me with this question.

Let us define a Markov hidden model with 2-states A and B, such that

P(X0=A)=0.6,P(X0=B)=0.4,P(X1=A/X0=A)=0.3,P(X1=B/X0=B)=0.8

what is the value of P(X3=A) ??

Welcome to MHB, betsyrocamora! :)

This looks like a question that is intended to learn what a hidden Markov model actually is.
Do your notes perhaps contain a worked example?
Or perhaps an example for a Markov chain?
 
I like Serena said:
Welcome to MHB, betsyrocamora! :)

This looks like a question that is intended to learn what a hidden Markov model actually is.
Do your notes perhaps contain a worked example?
Or perhaps an example for a Markov chain?

No, I know what is a hidden markov model, but with this one I am a little lost, I have tried to let j denote the state A. Used p3ij:=P(X3=j|X0=i) that satisfies the Chapman Kolmogorov equations and after that I think is the total probabilities ecuation but I am lost in there hahha
 
betsyrocamora said:
No, I know what is a hidden markov model, but with this one I am a little lost, I have tried to let j denote the state A. Used p3ij:=P(X3=j|X0=i) that satisfies the Chapman Kolmogorov equations and after that I think is the total probabilities ecuation but I am lost in there hahha

It seems to me you're making it unnecessarily complex.

From your given data we can deduce that $P(X_1=B\ |\ X_0=A)=0.7$ and $P(X_1=A\ |\ X_0=B)=0.2$.
You can write these numbers in a matrix M.
Then, assuming the Markov property being independent of n, we get:
$$\begin{bmatrix}{P(X_n=A) \\ P(X_n=B)}\end{bmatrix} = M^n \begin{bmatrix}{P(X_0=A) \\ P(X_0=B)}\end{bmatrix}$$
 

Similar threads

  • · Replies 1 ·
Replies
1
Views
1K
  • · Replies 4 ·
Replies
4
Views
3K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K
Replies
1
Views
1K
  • · Replies 2 ·
Replies
2
Views
2K
Replies
3
Views
2K
Replies
5
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 7 ·
Replies
7
Views
859