1-norm is larger than the Euclidean norm

  • Context: Graduate 
  • Thread starter Thread starter Dr. Seafood
  • Start date Start date
  • Tags Tags
    Euclidean Norm
Click For Summary
SUMMARY

The discussion confirms that the 1-norm, defined as \(\Vert{\vec{x}}\Vert_1 = \sum_{j=1}^n |x_j|\), is always greater than or equal to the Euclidean norm, \(\Vert{\vec{x}}\Vert = \sqrt{\sum_{j=1}^n x_j^2}\), for any vector \(\vec{x} \in \mathbb{R}^n\). The participants suggest proving this inequality by showing that \(\sum_{j=1}^n x_j^2 \leq \left(\sum_{j=1}^n |x_j|\right)^2\) using induction on \(n\). They also emphasize that the case for two variables can be demonstrated by algebraically manipulating the expressions, confirming the relationship between the two norms.

PREREQUISITES
  • Understanding of vector norms, specifically 1-norm and Euclidean norm.
  • Familiarity with mathematical induction techniques.
  • Basic knowledge of algebraic manipulation of inequalities.
  • Concept of unit balls in normed spaces.
NEXT STEPS
  • Study the proof of the Cauchy-Schwarz inequality to understand its relationship with norms.
  • Explore the geometric interpretation of norms and unit balls in \(\mathbb{R}^n\).
  • Learn about other norms, such as the p-norm, and their properties.
  • Investigate applications of norms in optimization problems and machine learning.
USEFUL FOR

Mathematicians, students studying linear algebra, and anyone interested in understanding vector norms and their properties in various applications.

Dr. Seafood
Messages
120
Reaction score
0
"1-norm" is larger than the Euclidean norm

Define, for each \vec{x} = (x_1, \ldots, x_n) \in \mathbb{R}^n, the (usual) Euclidean norm \Vert{\vec{x}}\Vert = \sqrt{\sum_{j = 1}^n x_j^2} and the 1-norm \Vert{\vec{x}}\Vert_1 = {\sum_{j = 1}^n |x_j|}.

How can we show that, for all \vec{x} \in \mathbb{R}^n, we have \Vert{\vec{x}}\Vert \leq \Vert{\vec{x}}\Vert_1?

I'm thinking of writing \Vert{\vec{x}}\Vert^2 \leq \Vert{\vec{x}}\Vert_1^2 and then showing (probably inductively) that the sum of squares of (finitely) many numbers is not larger than the square of the sum of the absolute values of the same numbers; i.e. show {\sum_{j = 1}^n x_j^2} \leq (\sum_{j = 1}^n |x_j|)^2 by induction on n. For n = 1 and 2 this is simple enough. The inductive step is tricky, but I feel like using an induction argument is totally overdoing it.

I ask this because I read that this is trivial, but I don't see it immediately. Do you?
 
Physics news on Phys.org


If you try writing out what
\left( \sum_{j = 1}^n |x_j| \right)^2 = \left( \sum_{i = 1}^n |x_i| \right) \cdot \left( \sum_{j = 1}^n |x_j| \right)
really means, you will find that it is equal to
\sum_{j = 1}^n x_j^2 + A
where you can quite easily show (from the explicit expression for A) that A > 0.
 


Dr. Seafood said:
Define, for each \vec{x} = (x_1, \ldots, x_n) \in \mathbb{R}^n, the (usual) Euclidean norm \Vert{\vec{x}}\Vert = \sqrt{\sum_{j = 1}^n x_j^2} and the 1-norm \Vert{\vec{x}}\Vert_1 = {\sum_{j = 1}^n |x_j|}.

How can we show that, for all \vec{x} \in \mathbb{R}^n, we have \Vert{\vec{x}}\Vert \leq \Vert{\vec{x}}\Vert_1?

I'm thinking of writing \Vert{\vec{x}}\Vert^2 \leq \Vert{\vec{x}}\Vert_1^2 and then showing (probably inductively) that the sum of squares of (finitely) many numbers is not larger than the square of the sum of the absolute values of the same numbers; i.e. show {\sum_{j = 1}^n x_j^2} \leq (\sum_{j = 1}^n |x_j|)^2 by induction on n. For n = 1 and 2 this is simple enough. The inductive step is tricky, but I feel like using an induction argument is totally overdoing it.

I ask this because I read that this is trivial, but I don't see it immediately. Do you?

work out the case for two variables first. Here you can see that the unit ball in the 1-norm is contained completely inside the unit ball for the 2 norm. Algebraically if x + y =1 then

x^2 + y^2 +2xy = 1 so the 2 norm is less than the 1 norm.
 

Similar threads

  • · Replies 1 ·
Replies
1
Views
3K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 5 ·
Replies
5
Views
3K
Replies
2
Views
2K
  • · Replies 12 ·
Replies
12
Views
3K
  • · Replies 3 ·
Replies
3
Views
3K
  • · Replies 16 ·
Replies
16
Views
4K
  • · Replies 6 ·
Replies
6
Views
3K