How to Calculate Matrix Norm in a Banach Space?

Click For Summary
SUMMARY

The discussion focuses on calculating the matrix norm of the matrix A = [[5, -2], [1, -1]] in a Banach space. Participants suggest various methods, including maximizing the function ||Az|| using constraints, employing the C*-identity for operator norms, and utilizing eigenvalues of the matrix A^TA. The consensus indicates that the operator norm can be effectively calculated using the largest eigenvalue of A^TA, which is derived from solving the determinant equation det(A^TA - λI) = 0. The final result for the norm is approximately 2.5.

PREREQUISITES
  • Understanding of matrix norms in Banach spaces
  • Familiarity with eigenvalues and eigenvectors
  • Knowledge of the C*-identity in functional analysis
  • Proficiency in using Lagrange multipliers for optimization problems
NEXT STEPS
  • Learn how to compute eigenvalues using the characteristic polynomial
  • Explore the properties of different matrix norms in Banach spaces
  • Study the application of Lagrange multipliers in constrained optimization
  • Investigate the relationship between matrix norms and operator theory
USEFUL FOR

Mathematicians, students of linear algebra, and professionals in applied mathematics who are interested in matrix analysis and optimization techniques in Banach spaces.

kalish1
Messages
79
Reaction score
0
How can I calculate the following matrix norm in a Banach Space:

$$
A=\begin{pmatrix}
5 & -2 \\
1 & -1 \\
\end{pmatrix}
?$$

I have tried $$\|A\|=\sup\limits_{\|x\|=1}\|Az\|$$

and then did $$Az=\begin{pmatrix}
5 & -2 \\
1 & -1 \\
\end{pmatrix} \cdot \begin{pmatrix} x \\ y \end{pmatrix} = \begin{pmatrix} 5x-2y \\ x-y \end{pmatrix}.$$

Now, how can I maximize the function $\|Az\|$? I'm not sure.

The norm is not specified in the problem. Should I just go with the square root of the sum of the squares of the compoments of Az, i.e. maximize $\sqrt{(5x-2y)^2+(x-y)^2}$ given the constraint $x^2+y^2=1$? Or should I maximize $\{{(5x-2y)^p+(x-y)^p}\}^{1/p}$ given the constraint $x^2+y^2=1$?

Any help would be appreciated.

I have crossposted this question here: calculus - Matrix norm in Banach space - Mathematics Stack Exchange
 
Physics news on Phys.org
If you want to calculate 2-norm,

(a) easy way I: use software such as Matlab;)

(b) easy way II: use $$\sqrt{\text{sup}(\lambda)}$$, where $$\lambda$$ is eigenvalue of $$A^TA$$.

(c) hard way: Let $$z=[x\text{ }y]^T$$ be unit vector. You need to maximize $$\parallel Az\parallel_2^2=z^TA^TAz$$, subject to $$\parallel z\parallel_2^2=z^Tz=1$$. By Lagrange multiplier method, it is to solve equations $$\bigtriangledown_z (z^TA^TAz-\lambda (z^Tz-1))=0$$ and $$z^Tz=1$$ (actually, it's not a typical optimization problem, but we can still do it like this, why?). At last, we have $$A^TAz=\lambda z$$. $$\lambda$$ is what easy way II speaks of.
 
Last edited:
kalish said:
How can I calculate the following matrix norm in a Banach Space:

$$
A=\begin{pmatrix}
5 & -2 \\
1 & -1 \\
\end{pmatrix}
?$$

I have tried $$\|A\|=\sup\limits_{\|x\|=1}\|Az\|$$

and then did $$Az=\begin{pmatrix}
5 & -2 \\
1 & -1 \\
\end{pmatrix} \cdot \begin{pmatrix} x \\ y \end{pmatrix} = \begin{pmatrix} 5x-2y \\ x-y \end{pmatrix}.$$

Now, how can I maximize the function $\|Az\|$? I'm not sure.

The norm is not specified in the problem. Should I just go with the square root of the sum of the squares of the compoments of Az, i.e. maximize $\sqrt{(5x-2y)^2+(x-y)^2}$ given the constraint $x^2+y^2=1$? Or should I maximize $\{{(5x-2y)^p+(x-y)^p}\}^{1/p}$ given the constraint $x^2+y^2=1$?

Any help would be appreciated.

I have crossposted this question here: calculus - Matrix norm in Banach space - Mathematics Stack Exchange

Since you are taking the sup of non-negative numbers, we may as well maximise $(5x-2y)^2+(x-y)^2$ subject to $x^2+y^2=1$ and then take square root at the end. The condition implies $x=cos{\alpha}$ and $y=sin{\alpha}$ for some ${\alpha}$. Rewriting $(5x-2y)^2+(x-y)^2$ using that, its obvious that the max occurs when $cos{\alpha}$ is positive and $sin{\alpha}=-cos{\alpha}$. So $(5x-2y)^2+(x-y)^2=6.27$ to 3.s.f. Square rooting gives the norm as approximately 2.5.
 
kalish said:
How can I calculate the following matrix norm in a Banach Space:

$$
A=\begin{pmatrix}
5 & -2 \\
1 & -1 \\
\end{pmatrix}
?$$

I have tried $$\|A\|=\sup\limits_{\|x\|=1}\|Az\|$$

and then did $$Az=\begin{pmatrix}
5 & -2 \\
1 & -1 \\
\end{pmatrix} \cdot \begin{pmatrix} x \\ y \end{pmatrix} = \begin{pmatrix} 5x-2y \\ x-y \end{pmatrix}.$$

Now, how can I maximize the function $\|Az\|$? I'm not sure.

The norm is not specified in the problem. Should I just go with the square root of the sum of the squares of the compoments of Az, i.e. maximize $\sqrt{(5x-2y)^2+(x-y)^2}$ given the constraint $x^2+y^2=1$? Or should I maximize $\{{(5x-2y)^p+(x-y)^p}\}^{1/p}$ given the constraint $x^2+y^2=1$?

Any help would be appreciated.

I have crossposted this question here: calculus - Matrix norm in Banach space - Mathematics Stack Exchange
There are many different norms for a matrix considered as an operator on a Banach space. If you want the operator norm of $A$ as an operator on 2-dimensional Euclidean space then the easiest way to calculate it is by using the C*-identity $\|A\|^2 = \|A^*A\|$, where $A^*$ is the Hermitian adjoint of $A$. In this case, $A^*A = \begin{bmatrix}5&1 \\-2&-1 \end{bmatrix} \begin{bmatrix}5&-2 \\1&-1 \end{bmatrix} = \begin{bmatrix}26&-11 \\-11&5 \end{bmatrix}.$ Since $A^*A$ is a positive matrix, its norm will be its largest eigenvalue, which you can find in the usual way by solving the quadratic equation $\det(A^*A - \lambda I) = 0.$ Then take the square root to get $\|A\|.$

Edit. I hadn't noticed that stainburg already suggested this method.
 
Last edited:

Similar threads

  • · Replies 4 ·
Replies
4
Views
1K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 9 ·
Replies
9
Views
5K
  • · Replies 6 ·
Replies
6
Views
2K
  • · Replies 12 ·
Replies
12
Views
3K
  • · Replies 2 ·
Replies
2
Views
1K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 6 ·
Replies
6
Views
1K
  • · Replies 8 ·
Replies
8
Views
1K
Replies
2
Views
1K