How can the l1 norm of a linear function be maximized?

  • Context: Graduate 
  • Thread starter Thread starter humbug
  • Start date Start date
  • Tags Tags
    Norm
Click For Summary
SUMMARY

The discussion focuses on maximizing the l1 norm of a linear function defined as z = c + Ax, where z is an (nx1) vector, A is an (nxm) matrix, and x is an (mx1) vector. The user seeks an effective algorithm or theorem to achieve this maximization, noting that traditional methods like the simplex algorithm are ineffective for this purpose. The user proposes that setting all but one element of x to zero may yield a solution, particularly when c is a constant vector, but acknowledges limitations in this approach. The conversation highlights the complexity of the problem, especially when considering the bounds of x.

PREREQUISITES
  • Understanding of l1 norm and its properties in linear algebra
  • Familiarity with convex analysis and optimization techniques
  • Knowledge of the simplex algorithm and its limitations
  • Basic concepts of linear programming and hyperplane theorems
NEXT STEPS
  • Research methods for maximizing l1 norm in linear programming
  • Explore the separating hyperplane theorem in the context of optimization
  • Study convex functions and their properties, particularly in relation to bounded variables
  • Investigate alternative algorithms for non-linear optimization problems
USEFUL FOR

Mathematicians, data scientists, and optimization specialists who are focused on linear programming and the maximization of linear functions, particularly in scenarios involving l1 norms and bounded variables.

humbug
Messages
2
Reaction score
0
Hi all,

Sorry if this is in the wrong section...first time and i couldn't see a convex analysis section.

I'm trying to find a good algorithm/theorem that will maximise the l1 norm (sum of absolute values) of a linear function. Namely, given a function z = c + Ax where z is (nx1), A is (nxm) and x is (mx1), what is the optimal way to choose x such that the sum of the absolute values of z are maximised (obviously x is bounded).

My problem scales really badly so its not feasible to just compute at the bounds of x and choose the biggest outcome. I've also found that the simplex algorithm cannot do it (it only works for minimising the l1 norm). I think the separating hyperplane theorem might be able to help but i can't really see how.

Any help/ideas would be greatly appreciated
 
Mathematics news on Phys.org
I think this will work - just make all but one element of x equal to zero. With the position of the one nonzero element corresponding to the column of A which has the maximum L1 norm.

Edit : Ok scrub that, it's only correct for c=0.

BTW c is a vector (nx1) isn't it?
 
Last edited:
In general c is a vector (nx1), however one of my cases deals with c being a constant vector so any thoughts on how to deal with that would also be helpful. As I understand it, if each element of x is in the interval [a,b], then shouldn't x be populated with a and b only? I thought that since the abs function is convex then its maximum will lie at the bounds always (or in other words, the solution lies at the corner of some hypercube). You can use this argument to turn the problem into a binomial choice problem if that makes things easier (thats what I'm playing with at the moment but it hasn't made it easier for me yet)
 

Similar threads

  • · Replies 8 ·
Replies
8
Views
3K
  • · Replies 13 ·
Replies
13
Views
4K
  • · Replies 4 ·
Replies
4
Views
3K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 3 ·
Replies
3
Views
3K
  • · Replies 0 ·
Replies
0
Views
3K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 46 ·
2
Replies
46
Views
9K
  • · Replies 5 ·
Replies
5
Views
2K