Derivative with respect to a vector

In summary, the conversation discusses taking the derivative with respect to a vector and the resulting equation being equal to A. The question asks for the derivative of the vector and matrix product, and the conversation ends with a discussion on working with tensor formalism and the interpretation of a derivative with respect to a vector or tensor.
  • #1
songCalculus
1
0
Hi, I have a question about doing derivative with respect to a vector, can someone help please.

Problem:
Suppose A is a (nxn) dimensional symmetric matrix, [tex]\vec{x}[/tex] is a (nx1) column vector.
We know that

[tex]\frac{d A\vec{x}}{d \vec{x}}=A[/tex]

and

[tex]\frac{d \vec{x}^TA\vec{x}}{d \vec{x}}=2A\vec{x}[/tex] ( A is symmetric)

question:

[tex]\frac{d \vec{x}^TA}{d \vec{x}}=?[/tex]

many thanks in advance!
 
Last edited:
Physics news on Phys.org
  • #2
Do you know how to work with tensor formalism? Using subscripts and superscripts.

Daniel.
 
  • #3
this should be A too. When A is not a function of x then take it out of the derivative and realize that dxi/dxj is simply (d)ij where (d) is the isentropic replacement tensor.
(Sorry I didn't feel like latex today)
 
  • #4
As dextercioby suggests, [tex]\frac{d \vec{x}^TA}{d \vec{x}}[/tex] can be written as (assuming that A is independent of x)
[tex]\frac{\partial (x_a A^a{}_b)}{\partial x^c}=\frac{\partial (x_a )}{\partial x^c}A^a{}_b+x_a \frac{\partial (A^a{}_b)}{\partial x^c}
=\delta_{ac}A^a{}_b+0
=A_{cb}
[/tex]
which is not exactly the object [tex]A^a{}_b[/tex] that we started with.

But, now, what is the interpretation of a "derivative with respect to a vector [or a tensor]"?
 

1. What is a derivative with respect to a vector?

A derivative with respect to a vector is a mathematical concept that describes how a function changes when its input vector is changed. It measures the rate of change of the function in a specific direction or along a specific vector.

2. How is a derivative with respect to a vector calculated?

The calculation of a derivative with respect to a vector is similar to the calculation of a derivative with respect to a scalar. However, instead of considering the change in only one input variable, it considers the change in multiple input variables, represented by a vector. This is typically done using the chain rule and the partial derivative notation.

3. What is the significance of a derivative with respect to a vector?

A derivative with respect to a vector has many applications in fields such as physics, engineering, economics, and machine learning. It allows for the optimization of functions with multiple variables and helps in understanding the behavior of complex systems.

4. Can a derivative with respect to a vector be negative?

Yes, a derivative with respect to a vector can be negative. This indicates that the function is decreasing along that particular vector direction. However, the magnitude of the negative derivative indicates the rate of decrease of the function.

5. How does a derivative with respect to a vector relate to gradient descent?

A derivative with respect to a vector is closely related to gradient descent, which is an optimization algorithm used to find the minimum of a function. The gradient, or the vector of partial derivatives, gives the direction of the steepest descent of the function. By updating the input vector in the direction opposite to the gradient, gradient descent can find the minimum of a function.

Similar threads

Replies
2
Views
1K
Replies
2
Views
966
Replies
2
Views
2K
Replies
2
Views
290
Replies
3
Views
456
Replies
1
Views
1K
  • Linear and Abstract Algebra
Replies
3
Views
291
  • Introductory Physics Homework Help
Replies
1
Views
346
  • Introductory Physics Homework Help
Replies
12
Views
196
Replies
27
Views
2K
Back
Top