Register to reply

Derivative of Log Determinant of a Matrix w.r.t a parameter

by CuppoJava
Tags: derivative, determinant, matrix, parameter
Share this thread:
Nov14-09, 06:28 PM
P: 24
I'm trying to see why the following theorem is true. It concerns the derivative of the log of the determinant of a symmetric matrix.

Here's the theorem as stated:

For a symmetric matrix A:
[tex]\frac{d}{dx} ln |A| = Tr[A^{-1} \frac{dA}{dx}][/tex]

Here's what I have so far, I'm almost at the answer, except I can't get rid of the second term at the end:

[tex]A = \sum_{i} \lambda_{i} u_{i} u_{i}^{T}[/tex]
[tex]A^{-1} = \sum_{i} \frac{1}{\lambda_{i}} u_{i} u_{i}^{T}[/tex]

[tex]A^{-1} \frac{dA}{dx} = \sum_{i} \frac{1}{\lambda_{i}} u_{i} u_{i}^{T} \frac{d}{dx}(\sum_{j}\lambda_{j} u_{j} u_{j}^{T})
=\sum_{i}\sum_{j}\frac{1}{\lambda_{i}}\frac{d\lambda_{j}}{dx}u_{i} u_{i}^{T}u_{j} u_{j}^{T} + \sum_{i}\sum_{j}\frac{\lambda_{j}}{\lambda_{i}}u_{i} u_{i}^{T}\frac{d}{dx}u_{j} u_{j}^{T}
=\sum_{i}\frac{1}{\lambda_{i}}\frac{d\lambda_{j}}{dx}u_{i} u_{i}^{T} + \sum_{i}\sum_{j}\frac{\lambda_{j}}{\lambda_{i}}u_{i} u_{i}^{T}\frac{d}{dx}u_{j} u_{j}^{T}[/tex]

And this would be just perfect if the second term was equal to zero. But I can't see how that could be made to happen.

Thanks a lot for your help
Phys.Org News Partner Science news on
What lit up the universe?
Sheepdogs use just two simple rules to round up large herds of sheep
Animals first flex their muscles
Apr3-10, 07:19 AM
P: 1
This theorem is true indeed, and doesn't even need A to be symmetric.

Using :
[tex] \frac{\partial}{\partial x} ln det A = \sum_{i,j} \frac{\partial a_{ij}}{x} \frac{\partial}{\partial a_{i,j}}[\tex]

with :
[tex]\frac{\partial }{\partial c_{ij}} ln det A = (A^{-1})_{ji}[\tex]

you get :
[tex] \frac{\partial}{\partial x} ln det A = Tr(A^{-1}\frac{\partial A}{\partial x}) = Tr(\frac{\partial A}{\partial x}A^{-1})[\tex]

I hope that will help...


Register to reply

Related Discussions
4x4 matrix determinant Precalculus Mathematics Homework 11
Determinant of 5x5 matrix Calculus & Beyond Homework 4
A SPECIAL Derivative of Matrix Determinant (tensor involved) Calculus 1
Determinant of matrix Linear & Abstract Algebra 4
Determinant of matrix Calculus & Beyond Homework 3