Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

Lagrangian Multiplier with Matrices

  1. Sep 17, 2009 #1
    I'm trying to use calculus of variations to solve for the probability distribution with highest entropy for a given covariance matrix. I want to maximize this:

    [tex]H[p(\vec{x})] = -\int p(\vec{x})*ln(p(\vec{x}))d\vec{x}[/tex]

    with the following constraints:

    [tex]\int p(\vec{x}) = 1[/tex]
    [tex]\int \vec{x}p(\vec{x})d\vec{x} = \vec{u}[/tex]
    [tex]\int (\vec{x}-\vec{u})(\vec{x}-\vec{u})^{T}p(\vec{x})d\vec{x} = \Sigma[/tex]

    Using Lagrangian multipliers, the proposed maximization function is:

    [tex]F[p(\vec{x})] = -\int p(\vec{x})*ln(p(\vec{x}))d\vec{x} + \lambda_{1}(\int p(\vec{x})d\vec{x}-1) + \vec{m}^{T}(\int \vec{x}p(\vec{x})d\vec{x} - \vec{u}) + Tr\{L(\int (\vec{x}-\vec{u})(\vec{x}-\vec{u})^{T}p(\vec{x})d\vec{x} - \Sigma)\}[/tex]

    I understand that m is needed because there is D constraints imposed by the mean. And L is needed because there is DxD constraints imposed by the covariances. But what is the trace operator doing in there?

    Thanks for the help
  2. jcsd
Know someone interested in this topic? Share this thread via Reddit, Google+, Twitter, or Facebook

Can you offer guidance or do you also need help?
Draft saved Draft deleted

Similar Discussions: Lagrangian Multiplier with Matrices
  1. Lagrangian multipliers (Replies: 2)

  2. Lagrange multiplier (Replies: 1)

  3. Lagrange multiplier (Replies: 6)

  4. Multiplying by dX (Replies: 8)