- #1
prhzn
- 9
- 0
Homework Statement
Consider a parameter [tex]\mathbf{\theta}[/tex] which changes with time according to the deterministic relation
[tex]\mathbf{\theta}\left[n\right] = \mathbf{A}\mathbf{\theta}\left[n-1\right]\; n\geq 1[/tex],
where [tex]\mathbf{A}[/tex] is a known [tex]p\times p[/tex] matrix and [tex]\mathbf{\theta}\left[0\right][/tex] is an unknown parameter which is modeled as a random ([tex]p\times 1[/tex]) vector. Note that once [tex]\mathbf{\theta}\left[0\right][/tex] is specified, so is [tex]\mathbf{\theta}\left[n\right][/tex] for [tex]n\geq 1[/tex].
Prove that the MMSE estimator of [tex]\mathbf{\theta}\left[n\right][/tex] is
[tex]\mathbf{\hat{\theta}}\left[n\right] =\mathbf{A}^n\mathbf{\hat{\theta}}\left[0\right][/tex],
where [tex]\mathbf{\hat{\theta}}\left[0\right][/tex] is the MMSE estimator of [tex]\mathbf{\theta}\left[0\right][/tex], or equivalently,
[tex]\mathbf{\hat{\theta}}\left[n\right] = \mathbf{A}\mathbf{\hat{\theta}}\left[n-1\right][/tex]
Homework Equations
MMSE: [tex]\hat{\theta} = \mathbb{E}\left[\theta|\mathbf{x}\right] = \int p\left(\theta\right)\ln\left(p\left(\theta|\mathbf{x}\right)\right)\mathrm{d}\theta[/tex]
The Attempt at a Solution
So far I haven't got any good attempt as my main problem is how to start. Until now, all exercises about MMSE that I've done have specified information about the PDF's to some of the variables or some other information that has made it more obvious how to start; however, with this I feel like I'm a bit lost. So mainly I'm just looking for a hint on how to start, such that I can do an fair attempt on my own.
Last edited: