Hi,(adsbygoogle = window.adsbygoogle || []).push({});

I'm trying to use calculus of variations to solve for the probability distribution with highest entropy for a given covariance matrix. I want to maximize this:

[tex]H[p(\vec{x})] = -\int p(\vec{x})*ln(p(\vec{x}))d\vec{x}[/tex]

with the following constraints:

[tex]\int p(\vec{x}) = 1[/tex]

[tex]\int \vec{x}p(\vec{x})d\vec{x} = \vec{u}[/tex]

[tex]\int (\vec{x}-\vec{u})(\vec{x}-\vec{u})^{T}p(\vec{x})d\vec{x} = \Sigma[/tex]

Using Lagrangian multipliers, the proposed maximization function is:

[tex]F[p(\vec{x})] = -\int p(\vec{x})*ln(p(\vec{x}))d\vec{x} + \lambda_{1}(\int p(\vec{x})d\vec{x}-1) + \vec{m}^{T}(\int \vec{x}p(\vec{x})d\vec{x} - \vec{u}) + Tr\{L(\int (\vec{x}-\vec{u})(\vec{x}-\vec{u})^{T}p(\vec{x})d\vec{x} - \Sigma)\}[/tex]

I understand that m is needed because there is D constraints imposed by the mean. And L is needed because there is DxD constraints imposed by the covariances. But what is the trace operator doing in there?

Thanks for the help

-Patrick

**Physics Forums - The Fusion of Science and Community**

The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

# Lagrangian Multiplier with Matrices

Can you offer guidance or do you also need help?

Draft saved
Draft deleted

Loading...

Similar Threads - Lagrangian Multiplier Matrices | Date |
---|---|

I Values of Lagrange multipliers when adding new constraints | Oct 31, 2017 |

I Optimizing fractions and Lagrange Multiplier | Aug 14, 2017 |

I Lagrangian differentiation | Apr 7, 2017 |

Express Langrange constraint that an expression*cannot* equal a value | Sep 29, 2014 |

Lagrangian multipliers | Mar 6, 2009 |

**Physics Forums - The Fusion of Science and Community**