Thank you for the answers, in between I have found an another reference, which is a direct derivation of the same result, for me this one seems to be easier to interpret:
Klein, A., and H. Neudecker. “A direct derivation of the exact Fisher information matrix of Gaussian vector state space...