Hence, the derivative of d/dx (x*x') is (d/dx)x*x'+x*x

  • Context: MHB 
  • Thread starter Thread starter Fernando Revilla
  • Start date Start date
  • Tags Tags
    Derivative
Click For Summary
SUMMARY

The derivative of the expression d/dx (x*x') where x is a vector and x' denotes the transpose of x is calculated using matrix differentiation rules. Specifically, if A and B are differentiable matrices, the product rule applies, yielding the derivative of the product as d/dx(AB) = (d/dx A)B + A(d/dx B). This leads to the conclusion that the derivative of the matrix product AA^T is given by d/dx(AA^T) = (d/dx A)A^T + A(d/dx A)^T, confirming the relationship for matrix derivatives in the interval (α, β).

PREREQUISITES
  • Understanding of matrix differentiation
  • Familiarity with vector and matrix notation
  • Knowledge of the product rule in calculus
  • Basic concepts of linear algebra
NEXT STEPS
  • Study matrix calculus, focusing on differentiation of matrix products
  • Learn about the properties of transpose matrices in differentiation
  • Explore applications of matrix derivatives in optimization problems
  • Investigate advanced topics in linear algebra, such as eigenvalues and eigenvectors
USEFUL FOR

Mathematicians, engineers, data scientists, and anyone involved in advanced calculus or linear algebra applications, particularly in fields requiring matrix manipulation and differentiation.

Fernando Revilla
Gold Member
MHB
Messages
631
Reaction score
0
I quote a question from Yahoo! Answers

What is the derivative of d/dx (x*x') where x is a vector and x' denotes x transpose (note that x*x' is a matrix, and not the norm of x!)

I have given a link to the topic there so the OP can see my response.
 
Physics news on Phys.org
In general, if $A=[a_{ij}(x)],\;B=[b_{ij}(x)]$ are matrices $n\times n$ with $a_{ij}(x)$ and $b_{ij}(x)$ differentiable real funtions defined on the open interval $(\alpha,\beta)$, its derivative matrices are defined by $$\frac{d}{dx}A=\left[\frac{d}{dx}a_{ij}(x)\right],\;\frac{d}{dx}B=\left[\frac{d}{dx}b_{ij}(x)\right]$$ Using the product formula: $$A(x)B(x)=C(x)=[c_{ij}(x)] \quad \left(c_{ij}(x)=\sum_{k=1}^na_{ik}(x)b_{kj}(x) \right)$$
it is easy to prove the relation on $(\alpha,\beta)$ $$\frac{d}{dx}(AB)=\left(\frac{d}{dx}A\right)B+A \left(\frac{d}{dx}B\right) $$
as a consequence $$\frac{d}{dx}(AA^T)=\left(\frac{d}{dx}A\right)A^T+A\left(\frac{d}{dx}A^T\right)=\left(\frac{d}{dx}A\right)A^T+A\left(\frac{d}{dx}A\right)^T$$
 

Similar threads

  • · Replies 11 ·
Replies
11
Views
2K
  • · Replies 4 ·
Replies
4
Views
3K
  • · Replies 4 ·
Replies
4
Views
4K
  • · Replies 9 ·
Replies
9
Views
3K
  • · Replies 4 ·
Replies
4
Views
4K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 8 ·
Replies
8
Views
3K
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 3 ·
Replies
3
Views
11K