Optimizing Rank p Matrix V for Symmetric Matrices with SVD Using Frobenius Norm

  • Context: Graduate 
  • Thread starter Thread starter doodle
  • Start date Start date
  • Tags Tags
    Minimization
Click For Summary
SUMMARY

The discussion focuses on optimizing a rank p matrix V for symmetric matrices R_1, R_2, and R_3 using Singular Value Decomposition (SVD) and the Frobenius norm. The objective function J is defined to minimize the difference between V's projections and the original matrices' projections. The user derived a critical equation involving Lagrange multipliers but is uncertain about the next steps. For the special case where p = 1, the optimal V corresponds to the eigenvector of the matrix formed by the weighted sum of the matrices' singular values.

PREREQUISITES
  • Understanding of Singular Value Decomposition (SVD)
  • Familiarity with Frobenius norm calculations
  • Knowledge of Lagrange multipliers in optimization
  • Linear algebra concepts, particularly eigenvalues and eigenvectors
NEXT STEPS
  • Research optimization techniques for matrix factorization problems
  • Explore advanced applications of Lagrange multipliers in constrained optimization
  • Study the properties of Frobenius norm in matrix approximations
  • Learn about eigenvalue problems in the context of symmetric matrices
USEFUL FOR

Mathematicians, data scientists, and machine learning practitioners working on matrix optimization problems, particularly in the context of dimensionality reduction and data approximation.

doodle
Messages
155
Reaction score
0
I have this matrix problem:

Given [itex]R_1, R_2, R_3\in\mathbb{R}^{N\times N}[/itex] are symmetric matrices with rank [itex]p<N[/itex]. Their SVD are [itex]U_1\Sigma_1 U_1^T[/itex], [itex]U_2\Sigma_2 U_2^T[/itex] and [itex]U_3\Sigma_3 U_3^T[/itex], respectively. I want to find a rank [itex]p[/itex] matrix [itex]V[/itex] such that

[tex]J = \|V\Sigma_1 V^T - U_1\Sigma_1 U_1^T\|_F^2 + \|V\Sigma_2 V^T - U_2\Sigma_2 U_2^T\|_F^2 + \|V\Sigma_3 V^T - U_3\Sigma_3 U_3^T\|_F^2[/tex]

is minimized, subject to the constraint [itex]V^T V = I[/itex].

I tried using the trace for the Frobenius norm and ended up with

[tex]2V (\Sigma_1^2 + \Sigma_2^2 + \Sigma_3^2) - 4(U_1\Sigma_1 U_1^T V \Sigma_1 + U_2\Sigma_2 U_2^T V \Sigma_2 + U_3\Sigma_3 U_3^T V \Sigma_3) + V(\Lambda + \Lambda^T) = 0[/tex]

where [itex]\Lambda[/itex] contains the Lagrange multipliers. I have no idea how to continue from here. Any help would be appreciated.
 
Last edited:
Physics news on Phys.org
I take it that there is no simple solution here?

In the case where p = 1, the solution for V (when I tried to work it out) is the eigenvector corresponding to the largest eigenvalue of

[tex]\Sigma_1 R_1 + \Sigma_2 R_2 + \Sigma_3 R_3[/tex]
 
Last edited:

Similar threads

  • · Replies 15 ·
Replies
15
Views
2K
  • · Replies 2 ·
Replies
2
Views
5K
  • · Replies 28 ·
Replies
28
Views
7K
  • · Replies 10 ·
Replies
10
Views
8K
  • · Replies 7 ·
Replies
7
Views
6K
  • · Replies 175 ·
6
Replies
175
Views
28K
  • · Replies 20 ·
Replies
20
Views
7K
  • · Replies 4 ·
Replies
4
Views
5K
  • · Replies 1 ·
Replies
1
Views
2K
Replies
1
Views
3K