What are the values of α for any initial value of x(0) in a linear system?

Click For Summary

Discussion Overview

The discussion revolves around determining the values of α for any initial value of x(0) in a linear system, particularly focusing on convergence criteria and numerical stability. Participants explore mathematical formulations and implications related to iterative methods.

Discussion Character

  • Technical explanation, Mathematical reasoning, Debate/contested

Main Points Raised

  • Some participants suggest that the question pertains to numerical stability, proposing that the absolute value of α times the norm of the matrix must be less than 1 for stability.
  • Others emphasize the need to find values of α that ensure convergence of the iteration process.
  • A participant references a first-order difference equation and provides a general solution involving α, suggesting a specific context involving vectors and matrices.
  • Another participant reiterates the convergence condition, stating that ||αA|| must be less than 1, leading to the conclusion that |α| must be less than 1/||A||.
  • Participants engage in mathematical derivations to illustrate how the distance from the limit affects convergence.

Areas of Agreement / Disagreement

There is no consensus on the specific values of α, but participants generally agree on the conditions necessary for convergence and stability, with multiple approaches and interpretations presented.

Contextual Notes

The discussion includes various assumptions about the nature of the matrix A and the initial conditions, which may affect the convergence criteria. Some mathematical steps and definitions remain unresolved.

Who May Find This Useful

Readers interested in numerical methods, linear systems, and convergence criteria in iterative processes may find this discussion relevant.

natalia
Messages
6
Reaction score
0
Considering the following

View attachment 2409
find the values for α for any initial value of x(0).

Any help will be useful, thank you!
 

Attachments

  • cap2_CalculNumeric.png
    cap2_CalculNumeric.png
    797 bytes · Views: 104
Physics news on Phys.org
natalia said:
Considering the following

View attachment 2409
find the values for α for any initial value of x(0).

Any help will be useful, thank you!

Welcome to MHB natalia! :)

Your problem needs a little more context.

I'm going to venture out and guess that this is about numerical stability.
The question might then be which values of $\alpha$ will reduce a worst case error in $x^{(0)}$.
In that case we can say that $\alpha$ times the norm of the matrix must have an absolute value that is smaller than 1.

Which context can you provide for this problem?
 
I need to find the values of $\alpha$ for which the iteration converges.
 
Last edited:
natalia said:
Considering the following

View attachment 2409
find the values for α for any initial value of x(0).

Any help will be useful, thank you!

Wellcome on MHB natalia!...

In...

http://mathhelpboards.com/discrete-mathematics-set-theory-logic-15/difference-equation-tutorial-draft-part-i-426-post2494.html

... it has been explained that the first order difference equation...$\displaystyle x_{n+1} = a\ x_{n} + b\ (1)$ ... has solution...

$\displaystyle x_{n} = x_{0}\ a^{n} + b\ \frac{1 - a^{n}}{1 - a}\ (2)$

In Your case I suppose that $\overrightarrow {x}_{n} $ and $\displaystyle \overrightarrow {b}$ are vectors of dimesion 2, $\alpha$ is a scalar and $\displaystyle A = \left | \begin{matrix} 2 & 1 \\ 1 & 2 \end{matrix} \right |$ a 2 x 2 Matrix, so that is...

$\displaystyle \overrightarrow {x}_{n+1} = \overrightarrow {b} + \alpha\ A\ \overrightarrow {x}_{n}\ (3)$

... and the solution of (3) is...

$\displaystyle \overrightarrow {x}_{n} = \overrightarrow {x}_{0}\ \alpha^{n}\ A^{n} + \overrightarrow {b}\ (I- \alpha^{n}\ A^{n})\ (I- \alpha\ A)^{-1}\ (4)$

... where I is the 2 x 2 identity matrix...

Kind regards

$\chi$ $\sigma$
 
Last edited:
natalia said:
I need to find the values of $\alpha$ for which the iteration converges.

Aha!

Actually, that turns out the same: you need $\alpha$ such that
$$||\alpha A || < 1$$
where $|| \cdot ||$ represents the matrix norm.
This is the same as:
$$|\alpha| \cdot || A || < 1$$
$$|\alpha| < \frac 1 {|| A ||}$$To explain, suppose the sequence converges (or should converge) to $y$.

Let $\Delta y^{(k)} = x^{(k)} - y$, which represents how far you are from the limit.
And let's call your matrix $A$ for ease of notation.

Then:
\begin{aligned}
x^{(k+1)} &= b + \alpha A x^{(k)} \\

&= b + \alpha A (y + \Delta y^{(k)}) \\

&= (b + \alpha A y) + \alpha A \Delta y^{(k)} \\

&= y + \alpha A \Delta y^{(k)}
\end{aligned}

That means that:
$$\Delta y^{(k+1)} = \alpha A \Delta y^{(k)}$$

In a worst case scenario this will only converge if
$$||\alpha A || < 1$$
where $|| \cdot ||$ represents the matrix norm.
 
Thank you very much, I like Serena :), your explanations are really clear.
 

Similar threads

  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 1 ·
Replies
1
Views
631
  • · Replies 2 ·
Replies
2
Views
3K
  • · Replies 2 ·
Replies
2
Views
4K
Replies
8
Views
2K
  • · Replies 12 ·
Replies
12
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 2 ·
Replies
2
Views
1K
  • · Replies 3 ·
Replies
3
Views
2K