Simple quadratic optimization problem

  • Context: Graduate 
  • Thread starter Thread starter nfreris2
  • Start date Start date
  • Tags Tags
    Optimization Quadratic
Click For Summary

Discussion Overview

The discussion revolves around a quadratic optimization problem involving matrices and vectors, specifically focusing on the minimization of a quadratic expression defined in terms of positive definite and semidefinite matrices. The scope includes theoretical exploration of matrix properties and optimization techniques.

Discussion Character

  • Technical explanation
  • Debate/contested

Main Points Raised

  • Post 1 presents a mathematical formulation for minimizing a quadratic expression involving matrices and vectors, questioning the conditions under which this minimization occurs.
  • Post 2 raises a concern about a potential typo regarding the dimensions of K and the implications for the matrix multiplication involving KQK*, suggesting that K should be a row vector for the expression to be valid.
  • Post 3 confirms that Q is a scalar, which may clarify the earlier confusion regarding the dimensions.
  • Post 4 prompts further thoughts on the problem, inviting additional input from participants.

Areas of Agreement / Disagreement

Participants have not reached a consensus, as there are differing views on the dimensionality of K and its implications for the mathematical expressions involved.

Contextual Notes

There are unresolved questions regarding the definitions and assumptions about the dimensions of the matrices and vectors involved, particularly concerning the multiplication of K, Q, and K*.

Who May Find This Useful

Researchers and students interested in quadratic optimization, matrix theory, and related mathematical concepts may find this discussion relevant.

nfreris2
Messages
1
Reaction score
0
Let [tex]P^ + ,P^ - ,I,Q \in R^{n\times n}, K\in R^{n\times 1}, M\in R^{1 \times n}[/tex], and assume that [tex]Q[/tex] is positive definite, [tex]P^ -[/tex] is positive semidefinite whence [tex](MP^ - M^T + Q)^{ - 1}[/tex] exists (where [tex]T[/tex] denotes transpose).

In what sense does [tex]K = P^ - M^T(MP^ - M^T + Q)^{ - 1}[/tex] minimize the quadratic expression [tex]P^ + : = (I - KM)P^ - (I - KM)^T + KQK^T[/tex], over [tex]K[/tex]?
Is this minimization of [tex]P^ +[/tex] over all vectors [tex]K[/tex] with respect to the usual ordering for positive semidefinite matrices [tex]A\le B[/tex] iff [tex]B - A[/tex]is positive semidefinite?

Next consider the extension [tex]P^ + : = (I - KAM)P^ - (I - KAM)^T + KAQA^TK^T[/tex], where [tex]A\in R^{n\times 1}, K\in R^{n\times n}[/tex] and [tex]K[/tex] diagonal, where all other matrices are as above.
What is the minimum over [tex]K[/tex] (with respect to the previous ordering or something )??

Any help will be deeply appreciated.
 
Physics news on Phys.org
I think maybe there is a typo, because if K is a column vector (in Rnx1) and Q a square matrix then KQK* is meaningless, you can't do that matrix multiplication. However, if you meant that K is a row vector, then that implies KQK* is a scalar, so it cannot possibly add to anything to equal the nxn matrix P+.
 
That is correct [tex]Q > 0[/tex], a scalar.

Please help with this.
 
What are your thoughts on the problem so far?
 

Similar threads

  • · Replies 5 ·
Replies
5
Views
3K
Replies
3
Views
2K
  • · Replies 2 ·
Replies
2
Views
1K
  • · Replies 3 ·
Replies
3
Views
3K
  • · Replies 11 ·
Replies
11
Views
4K
  • · Replies 3 ·
Replies
3
Views
4K
  • · Replies 3 ·
Replies
3
Views
3K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 6 ·
Replies
6
Views
2K