- #1
hkBattousai
- 64
- 0
Here is a snapshot from one of my textbooks:
[PLAIN]http://img64.imageshack.us/img64/8114/vector0.png
How do we take the derivative below?
[itex]\frac{d}{dx}\Huge(\normalsize x^TA^TAx\,-\,2x^TA^Tb \Huge)\normalsize\,=\,2A^TAx\,-\,2A^Tb[/itex]
There is also another vector derivative in the book as follows:
[itex]\frac{d}{dx}\Huge(\normalsize x^Tx \Huge)\normalsize \, = \, 2x^T[/itex]
How do we take these type of derivatives?
What is the meaning of taking derivative of a vector, or transpose of vector?
_____________
EDIT: I found http://en.wikipedia.org/wiki/Matrix_calculus#Derivative_of_linear_functions", but it doesn't either explain the main idea behind vector derivation.
[itex]\frac{\partial \; \textbf{a}^T\textbf{x}}{\partial \; \textbf{x}} = \frac{\partial \; \textbf{x}^T\textbf{a}}{\partial \; \textbf{x}} = \textbf{a}[/itex]
[itex]\frac{\partial \; \textbf{A}\textbf{x}}{\partial \; \textbf{x}} = \frac{\partial \; \textbf{x}^T\textbf{A}}{\partial \; \textbf{x}^T} = \textbf{A}[/itex]
[PLAIN]http://img64.imageshack.us/img64/8114/vector0.png
How do we take the derivative below?
[itex]\frac{d}{dx}\Huge(\normalsize x^TA^TAx\,-\,2x^TA^Tb \Huge)\normalsize\,=\,2A^TAx\,-\,2A^Tb[/itex]
There is also another vector derivative in the book as follows:
[itex]\frac{d}{dx}\Huge(\normalsize x^Tx \Huge)\normalsize \, = \, 2x^T[/itex]
How do we take these type of derivatives?
What is the meaning of taking derivative of a vector, or transpose of vector?
_____________
EDIT: I found http://en.wikipedia.org/wiki/Matrix_calculus#Derivative_of_linear_functions", but it doesn't either explain the main idea behind vector derivation.
[itex]\frac{\partial \; \textbf{a}^T\textbf{x}}{\partial \; \textbf{x}} = \frac{\partial \; \textbf{x}^T\textbf{a}}{\partial \; \textbf{x}} = \textbf{a}[/itex]
[itex]\frac{\partial \; \textbf{A}\textbf{x}}{\partial \; \textbf{x}} = \frac{\partial \; \textbf{x}^T\textbf{A}}{\partial \; \textbf{x}^T} = \textbf{A}[/itex]
Last edited by a moderator: