Maximization problem of tuple set

  • Context: Graduate 
  • Thread starter Thread starter brydustin
  • Start date Start date
  • Tags Tags
    Maximization Set
Click For Summary
SUMMARY

The discussion focuses on maximizing the sum of squared distances between transformed unit vectors in R^3. The transformation is defined by the equation v'_i = Σ_k=1 to N (c_k,i) * v_i, where c_k,i are scalars to be determined. Key steps include assessing the rank of the Nx3 matrix of vectors and ensuring that the vectors are evenly distributed on a unit sphere. The use of energy functions, specifically φ_ij = -log(||x_i - x_j||^2), is proposed to facilitate the optimization process through gradient descent.

PREREQUISITES
  • Understanding of vector transformations in R^3
  • Familiarity with optimization techniques, specifically gradient descent
  • Knowledge of matrix rank and its implications in vector spaces
  • Basic concepts of energy functions in mathematical optimization
NEXT STEPS
  • Explore the properties of unit vectors on a sphere and their distribution
  • Study the application of gradient descent in multi-variable optimization problems
  • Research energy functions and their role in optimization frameworks
  • Investigate the implications of matrix rank in vector space problems
USEFUL FOR

Mathematicians, data scientists, and engineers involved in optimization problems, particularly those working with vector transformations and energy minimization techniques.

brydustin
Messages
201
Reaction score
0
Given a set of vectors {v_ j } = {v_1, ... v_N} and I wish to transform each vector in the following manner

v_ i ' = Sum_k=1 to N ( c_ k,i) * v_i where c_ k,i is a scalar and what we are trying to solve for.

such that the sum of the distances squared between each pair of transformed vectors is maximized.

Then we would like to solve dD/dc = 0 where D is the sum of the distances squared and c are the scalars in matrix form. I'm not sure how to think of the c's except I could define a diagonal matrix whose entries are the sum of the respective scalars (i.e. i-th row is Sum_k=1 to N ( c_ k,i)) and multiply it by a vector (tensor) whose elements are the v_ j's so that the new vector has as its elements the transformed vectors.
 
Last edited:
Physics news on Phys.org
We talked about it in chat --
He forgot to mention:

1. All vectors are in [tex]R^{3}[/tex]
2. All v and v' are unit vectors (otherwise it's impossible to maximize)

So, I think first thing to do is find the rank of the Nx3 matrix of v's. If rank is < 3, the problem is trivial. Otherwise we just need to find a set of unit vectors that are 'equally' spread on a unit sphere. So, for N = 3 they would be coplanar with 120 degree angles, N=4 would make a tetrahedron, N = 6, 8 make cubes etc.

I don't know if there is a general closed formula for the N vectors. However, if we define energy functions [tex]\varphi_{ij} = - log(||x_{i} - x_{j}||^2)[/tex], and total energy function [tex]\Phi = \sum{\varphi_{ij}}[/tex], we can find partial derivatives of [tex]\Phi[/tex] wrt each [tex]x_{i}^{(k)}[/tex] and then use some algorithm like gradient descent to find the answer.

Danil
 

Similar threads

  • · Replies 0 ·
Replies
0
Views
3K
  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 7 ·
Replies
7
Views
3K
Replies
2
Views
2K
  • · Replies 8 ·
Replies
8
Views
4K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 0 ·
Replies
0
Views
4K
  • · Replies 8 ·
Replies
8
Views
1K
Replies
10
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K