Kalman Filter Derivation with Non-Diagonal Q Matrix

Click For Summary
SUMMARY

The discussion centers on the derivation of the Kalman filter with a non-diagonal process noise covariance matrix Q. It is established that the Kalman filter formulation does not necessitate Q to be diagonal; it only requires Q to be a symmetric positive semidefinite matrix. Additionally, the conversation touches on the likelihood estimation of coefficients when the transition matrix T is influenced by exogenous variables, and the use of Cholesky decomposition for selecting a transformation matrix in dynamic factor models.

PREREQUISITES
  • Understanding of Kalman filter theory and its mathematical formulation
  • Knowledge of covariance matrices and their properties, specifically symmetric positive semidefinite matrices
  • Familiarity with likelihood estimation techniques in state-space models
  • Experience with Cholesky decomposition and its application in matrix transformations
NEXT STEPS
  • Study the derivation of the Kalman filter with non-diagonal Q matrices
  • Explore likelihood estimation methods for state-space models with exogenous variables
  • Learn about dynamic factor models and their transformation approaches
  • Investigate the application of Cholesky decomposition in selecting transformation matrices
USEFUL FOR

Researchers, data scientists, and statisticians working with state-space models, particularly those interested in Kalman filtering and dynamic factor analysis.

spirall
Messages
2
Reaction score
0
Hi all,

I have a standard local level model, but the disturbances are not independent:
y_t=μ_t+ε_t, μ_t+1=μ_t+η_t, E(ε_t η_t) =/= 0

In order to derive the Kalman filter, I rewrite this model in state space form
y_t=Z_t α_t+ε_t, ε_t~NID(0,H_t ),
α_(t+1)=T_t α_t+R_t η_t, η_t~NID(0,Q_t ),
α_1~N(a_1,P_1 ),

α_t=[μ_t
ξ_t ]

Z_t=[1 1],
H_t=0,

Q_t=[σ_η^2 σ_ξη
σ_ξη σ_ξ^2 ],

T_t=[1 0
0 0],

R_t=[1 0
0 1],

η_t=[η_t
ξ_(t+1)].

I wonder whether there is any difference in the derivation of the Kalman filter, since the matrix Q in not diagonal.

Thank you
 
Mathematics news on Phys.org
There's nothing in the formulation or derivation of the Kalman filter that requires the noise matrix Q to be diagonal. It just needs to qualify as a covariance matrix. In other words, it needs to be a symmetric positive semidefinite matrix.
 
Thank you for reply.

And what about likelihood estimation of coefficients of system matrices if the transition matrix T depends on some exogenous variables (I suppose this is possible)?

I have one more question about dynamic factor model. I consider transformation approach (yL_t=A_L y_t) and look for transformation matrix A=[A_L A_H]' such as:
Ʃ_L=A_L H A´_L
A_L=CZ´H^-1
If I use Cholesky decomposition, the matrix C should be lower triangular. But how I choose it?
 

Similar threads

  • · Replies 3 ·
Replies
3
Views
3K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 7 ·
Replies
7
Views
22K
Replies
2
Views
3K
  • · Replies 1 ·
Replies
1
Views
4K