Comparing Viterbi & Kalman Filters for Dynamic HMM

  • Thread starter EmmaSaunders1
  • Start date
In summary, the key differences between the Kalman filter and Viterbi algorithm when modeling a dynamic hidden Markov chain are as follows: The Viterbi algorithm provides the maximum a posteriori (MAP) estimate of hidden state variables, resulting in a single most likely state sequence, while the Kalman filter provides the individual most probable states given all observations, which can be combined to give the most likely states in a minimum mean square error (MMSE) sense. The Viterbi algorithm is used for discrete models, while the Kalman filter can approach the same result if the system is continuous. However, if the Kalman filter assumes a discrete state space but the underlying physical process is continuous, the accuracy of the results may be
  • #1
EmmaSaunders1
45
0
HI All,

Would someone be-able to clarify the key differences between the kalman filter (including smoothing) and Viterbi algorithm when modelling a dynamic hidden Markov chain from a results point of view.

I understand that the Viterbi algorithm will give the MAP estimate of hidden state variables given all observations, resulting in the single most likely state sequence. The kalman filter will give the individual most probable states given all observables which can be concatenated to give the most likely (in a MMSE sense) states given observations.

I am slightly confused as to which algorithm performs the best. The Viterbi algorithm is used in a discrete model, the Kalman will approach the same result as the Viterbi if the system is continuous, what if however the kalman filter you are using assumes a discrete state space but the underlying physical process is continuous?

Thanks for any help
 
Engineering news on Phys.org
  • #2
It's just like anything else. How well does the discrete approximation represent the real process? You must answer that question first and foremost.

But also look at these related PF threads.
https://www.physicsforums.com/search/25857/?q=Viterbi++Kalman&o=relevance
 

Related to Comparing Viterbi & Kalman Filters for Dynamic HMM

1. What is a Viterbi filter and how does it work?

The Viterbi filter is a mathematical algorithm used for finding the most likely sequence of hidden states in a Hidden Markov Model (HMM). It works by calculating the probability of each possible state at each time step and then choosing the most probable state at each step, resulting in the most likely sequence of states.

2. How does a Kalman filter differ from a Viterbi filter?

A Kalman filter is also used for estimating the state of a system in a HMM, but it differs from a Viterbi filter in that it takes into account the uncertainty or noise in the measurements, whereas the Viterbi filter assumes perfect measurements. Additionally, the Kalman filter can handle continuous state spaces, while the Viterbi filter is limited to discrete state spaces.

3. When would you use a Viterbi filter over a Kalman filter?

A Viterbi filter is more suitable for cases where the measurements are highly accurate and the state space is discrete. This could include applications in speech recognition, pattern recognition, and image processing. In these cases, the Viterbi filter can provide a more accurate estimation of the hidden states compared to the Kalman filter.

4. Can a Viterbi filter and a Kalman filter be used together?

Yes, a combination of Viterbi and Kalman filters, known as the Viterbi-Kalman filter, can be used to improve the accuracy of state estimation. This approach takes advantage of the strengths of both filters – the Viterbi filter for finding the most likely sequence of states and the Kalman filter for incorporating sensor noise and uncertainty.

5. What are some real-world applications of Viterbi and Kalman filters?

Viterbi and Kalman filters have a wide range of applications in various fields such as telecommunications, robotics, finance, and biology. Some examples include speech recognition, object tracking, financial market analysis, and DNA sequence analysis. They are also commonly used in navigation systems, such as GPS, for accurately estimating the position of an object based on noisy measurements.

Similar threads

Replies
6
Views
2K
  • General Engineering
Replies
6
Views
2K
Replies
1
Views
1K
Replies
2
Views
3K
Replies
7
Views
3K
Replies
1
Views
4K
Replies
1
Views
2K
  • Set Theory, Logic, Probability, Statistics
Replies
5
Views
6K
  • Set Theory, Logic, Probability, Statistics
Replies
1
Views
1K
Replies
5
Views
2K
Back
Top