Convergence of iteration method - Relation between norm and eigenvalue

Click For Summary
SUMMARY

The convergence of an iteration method is determined solely by the spectral radius of the iteration matrix, denoted as $\rho(G)$, which must be less than 1 for convergence to occur. Regardless of the norms of the matrix $G$, such as $\|G\|_{\infty}=3$ or $\|G\|_{1}=1$, if $\rho(G)<1$, the iteration method will converge. Additionally, for a symmetric matrix $A$, if the norm $\|A\|=0.01$, there exists an eigenvalue $\lambda$ such that $|\lambda| = 0.01$, confirming that the spectral radius equals the norm in this case.

PREREQUISITES
  • Understanding of spectral radius and its implications for convergence
  • Knowledge of matrix norms, specifically $\|G\|_{\infty}$ and $\|G\|_{1}$
  • Familiarity with eigenvalues and their relationship to matrix norms
  • Basic concepts of iteration methods in numerical analysis
NEXT STEPS
  • Study the properties of spectral radius in iterative methods
  • Explore the implications of matrix norms on convergence rates
  • Learn about the relationship between eigenvalues and matrix norms in symmetric matrices
  • Investigate various iteration methods and their convergence criteria
USEFUL FOR

Mathematicians, numerical analysts, and anyone involved in computational methods for solving linear systems will benefit from this discussion.

mathmari
Gold Member
MHB
Messages
4,984
Reaction score
7
Hey! :o

Let $G$ be the iteration matrix of an iteration method. So that the iteration method converges is the only condition that the spectral radius id less than $1$, $\rho (G)<1$, no matter what holds for the norms of $G$ ?
I mean if it holds that $\|G\|_{\infty}=3$ and $\rho (G)=0.3<1$ or $\|G\|_{1}=1$ and $\rho (G)=0.1<1$ in these both cases the iteration method converges, or not? (Wondering)

I have also an other question. Let $A$ be a symmetric matrix. If $\|A\|=0.01$ then there is an eigenvalue $\lambda$ with $|\lambda|\leq 0.01$, isn't it? We get that using the spectral radius: $\rho (A)=\max |\lambda_i|\leq \|A\|_1$, right? (Wondering)
 
Physics news on Phys.org
mathmari said:
Let $G$ be the iteration matrix of an iteration method. So that the iteration method converges is the only condition that the spectral radius id less than $1$, $\rho (G)<1$, no matter what holds for the norms of $G$ ?
I mean if it holds that $\|G\|_{\infty}=3$ and $\rho (G)=0.3<1$ or $\|G\|_{1}=1$ and $\rho (G)=0.1<1$ in these both cases the iteration method converges, or not? (Wondering)
For an iteration procedure, you are going to be interested in powers of $G$. So what matters is that $\|G^n\| < 1$ when $n$ is large. It doesn't matter whether $G$ itself has norm larger than $1$, so long as the powers of $G$ have smaller norms.

The spectral radius has the property that $$\rho(G) = \lim_{n\to\infty}\|G^n\|^{1/n}.$$ So if $\rho(G)<1$ then $\|G^n\|<1$ whenever $n$ is large enough, and that is sufficient to ensure that the iteration method converges.

mathmari said:
I have also an other question. Let $A$ be a symmetric matrix. If $\|A\|=0.01$ then there is an eigenvalue $\lambda$ with $|\lambda|\leq 0.01$, isn't it? We get that using the spectral radius: $\rho (A)=\max |\lambda_i|\leq \|A\|_1$, right? (Wondering)
For a symmetric matrix, the spectral radius is equal to the norm. So if $\|A\|=0.01$ then there is actually an eigenvalue $\lambda$ with $|\lambda| = 0.01$.
 
Opalg said:
For an iteration procedure, you are going to be interested in powers of $G$. So what matters is that $\|G^n\| < 1$ when $n$ is large. It doesn't matter whether $G$ itself has norm larger than $1$, so long as the powers of $G$ have smaller norms.

The spectral radius has the property that $$\rho(G) = \lim_{n\to\infty}\|G^n\|^{1/n}.$$ So if $\rho(G)<1$ then $\|G^n\|<1$ whenever $n$ is large enough, and that is sufficient to ensure that the iteration method converges.For a symmetric matrix, the spectral radius is equal to the norm. So if $\|A\|=0.01$ then there is actually an eigenvalue $\lambda$ with $|\lambda| = 0.01$.
I see! Thank you very much! (Smile)
 

Similar threads

  • · Replies 9 ·
Replies
9
Views
3K
  • · Replies 3 ·
Replies
3
Views
3K
  • · Replies 10 ·
Replies
10
Views
1K
  • · Replies 8 ·
Replies
8
Views
2K
  • · Replies 21 ·
Replies
21
Views
4K
  • · Replies 15 ·
Replies
15
Views
3K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 6 ·
Replies
6
Views
2K