Numerical Analysis/stability of Multistep methods

For multistep methods, the problems involved with consistence, convergence and stability are complicated because of the number of approximations involved at each step. In the one step method, the approximation $w_{i+1}$ depends only on the previous approximation $w_{i}$, whereas the multistep methods use at least two of the previous approximations, and the usual method that are employed involve more.

Stable Multistep Method

Characteristic polynominals

For the multistep method:

$w_{0}=\alpha ,w_{1}=\alpha _{1},...,w_{m-1}=\alpha _{m-1}$,

$w_{i+1}=a_{m-1}w_{i}+a_{m-2}w_{i-1}+...+a_{0}w_{i+1-m}+hF(t_{i},h,w_{i+1},w_{i},...,w_{i+1-m})$,

the polynominal

$P(\lambda )=\lambda ^{m}-a_{m-1}\lambda ^{m-1}-a_{m-2}\lambda ^{m-2}-...a_{1}\lambda -a_{0}$ ,

is called the characteristic polynominal of the above mutistep method.

The stability of a multistep method with respect to round-off error is dictated by the magnitudes of the zeros of the characteristic polynominal.

Root condition

Let $\lambda _{1},\lambda _{2},...,\lambda _{m},$ denote the (not necessarily distinct) roots of the characteristic equation

$P(\lambda )=\lambda ^{m}-a_{m-1}\lambda ^{m-1}-a_{m-2}\lambda ^{m-2}-...a_{1}\lambda -a_{0}=0$ ,

associated with the multistep difference method

$w_{0}=\alpha _{0},w_{1}=\alpha _{1},...,w_{m-1}=\alpha _{m-1}$,

$w_{i+1}=a_{m-1}w_{i}+a_{m-2}w_{i-1}+...+a_{0}w_{i+1-m}+hF(t_{i},h,w_{i+1},w_{i},...,w_{i+1-m})\,.$

If the absolute value $|\lambda _{i}|\leq 1$, for each i=1,2,...,m, and all roots with abosolute value 1 are the simple roots, then the difference method is said to satisfy the root condition.

Stability Definitions

1. Methods that satisfy the root condition and have $\lambda =1$ as the only root of the characteristic equation of the magnitude one are called strongly stable.
2. Methods that satisfy the root condition and have more than one distinct root with magnitude one are called weakly stable.
3. Methods that do not satisfy the root condition are called unstable.

Stable Multistep methods

A multistep method of the form

$w_{0}=\alpha _{0},w_{1}=\alpha _{1},...,w_{m-1}=\alpha _{m-1}$,

$w_{i+1}=a_{m-1}w_{i}+a_{m-2}w_{i-1}+...+a_{0}w_{i+1-m}+hF(t_{i},h,w_{i+1},w_{i},...,w_{i+1-m})$,

is stable if and only if it satisfies the root condition. Moreover, if the difference method is consistent with the differential equation, then the method is stable if and only if it is convergent.

Examples

Example1

The fourth-order Adams-Bashfoth method is

$w_{i+1}=w_{i}+(h/24)(55f_{i}-59f_{i-1}+37f_{i-2}-9f_{i-3}),$

where $f_{i}=f(t_{i},w_{i})\,.$ The characteristic equation is

$\lambda ^{4}-\lambda ^{3}=\lambda ^{3}(\lambda -1)=0$

so we find the characteristic roots to be

$\lambda _{1}=1,\quad \lambda _{2}=0,\quad \lambda _{3}=0,\quad {\text{and}}\quad \lambda _{4}=0\,.$

Thus the 4th-order Adams Method satisfies the root condition and is strongly stable.

Example 2

Milne's Method is

$w_{i+1}=w_{i-3}+(4h/3)(2f_{i}-f_{i-1}+2f_{i-2}),$

where $f_{i}=f(t_{i},w_{i})\,.$ The characteristic equation is

$\lambda ^{4}-1=0$

so the characteristic roots are $\lambda _{1}=1,\quad \lambda _{2}=-1,\quad \lambda _{3}=i,\quad {\text{and}}\quad \lambda _{4}=-i.$

Thus the 4th-order Milne's Method satisfies the root condition, but it is only weakly stable.

Absolute Stability & Region of Absolute stability

Definition

Apply a numerical method to initial-value problem

$y'=\lambda y$

$y(0)=\alpha \quad {\text{where}}\quad {\text{Re}}(\lambda )<0\,.$

Suppose that a round off error $\xi _{0}$ is introduced in the initial condition for this method. At the nth step the round off error is $\xi _{n}$. Provided the step size h is chosen to satisfy $|\xi _{n}|<|\xi _{0}|$, the numerical method is said to be absolutely stable for the step size h. And $R=$$\{h\lambda \in \mathbb {C} ||\xi _{n}|<|\xi _{0}|\}$ is said to be region of absolute stability for numerical method.

Region of absolute stability for one-step method

In general, when a one-step method is applied to the test equation, a function $Q$ exists with the property that the difference method gives

$w_{i+1}=Q(h$$\lambda )w_{i}$.

The initial round-off error $\xi _{0}$ and the round-off error at the ith step $\xi _{i}$ will satisfy $\xi _{i+1}=Q(h$$\lambda )\xi _{i}$ which is $\xi _{i+1}=Q^{i}(h\lambda )\xi _{0}$.

The inequality $|\xi _{i}|<|\xi _{0}|$ will hold if $|Q(h\lambda )|<1$. Thus, region R of absolute stability for a one-step method is

$R=$$\{h\lambda \in \mathbb {C} ||Q(h$$\lambda )|<1\}\,.$

Region of absolute stability for multistep methods

Consider the k-step method

$w_{n+1}=\sum _{j=1}^{k}a_{k-j}w_{n+1-j}+h\sum _{j=0}^{k}b_{k-j}f_{n-j+1}$

$f_{n-j+1}=f(t_{n-j+1},w_{n-j+1})\,.$

Applying it to

$y'=\lambda y$

we get

$w_{n+1}=\sum _{j=1}^{k}a_{k-j}w_{n+1-j}+\lambda h\sum _{j=0}^{k}b_{k-j}w_{n-j+1}$

$\Leftrightarrow (1-\lambda hb_{k})w_{n+1}-\sum _{j=1}^{k}(a_{k-j}-\lambda hb_{k-j})w_{n+1-j}=0\,.$

The characteristic polynominal of the method is

$Q(z,h\lambda )=(1-$$\lambda hb_{k})z^{k}-\sum _{j=1}^{k}(a_{k-j}-$ $\lambda hb_{k-j})z^{k-j}=0$

The region R of absolute stability for a multistep method is

$R=$$\{h\lambda \in \mathbb {C} ||\beta _{j}|<1,{\text{ for all zeros }}\beta _{j}{\text{ of }}Q(z,h\lambda )\}$.

Example

Determine the region of absolute stability for two step method $w_{i+1}=w_{i}+h/2(3f_{i}-f_{i-1})$.

Applying this method to: $y'=\lambda y$, gives

$w_{i+1}=w_{i}+\lambda h(3w_{i}-w_{i-1})/2$

$\Leftrightarrow w_{i+1}-(1+3h\lambda /2)w_{i}+\lambda h/2w_{i-1}=0\,.$

The characteristic polynominal of above method is

$Q(z,h\lambda )=z^{2}-(1+3h\lambda /2)z+h\lambda /2$

All the zeros of the characteristic polynominal are

$z_{1,2}={+(1+3h\lambda /2)\pm {\sqrt {1+\lambda h+9\lambda ^{2}h^{2}/4}} \over 2}\,.$

Thus the region of absolute stability for this method is $R=$$\{h\lambda \in \mathbb {C} ||z_{1,2}|<1\}$.

Exercises

Exercise 1

Find the region of the absolute stability of Euler's method:

$w_{k+1}=w_{k}+hf(t_{k},w_{k}).$

Solution:

Applying Euler's method to test equation: $y'=\lambda y$, gives

$w_{k+1}=w_{k}+\lambda hw_{k}=(1+\lambda h)w_{k}\,.$

The region R of absolute stability for Euler's method is

$R=$$\{h\lambda \in \mathbb {C} ||1+\lambda h|<1\}$

That is $Q(h\lambda )=1+h\lambda$.

 

Exercise 2

Find the region R of the absolute stability of Trapezoidal method

$w_{k+1}=w_{k}+h/2(f(t_{k},w_{k})+f(t_{k+1},w_{k+1})).$

Solution:

Applying Trapezoidal method method to test equation: $y'=\lambda y$, gives

$w_{k+1}=w_{k}+\lambda h(w_{k}+w_{k+1})/2\,$

which simplifies to

$w_{k+1}=(1+z/2)/(1-z/2)w_{k}$

where $z=\lambda h$, so $Q(z)=(1+z/2)/(1-z/2)$.

The inequality will hold if $Re(z)<0$. The region R of absolute stability is

$R=$$\{h\lambda \in \mathbb {C} |Re(\lambda h)<0\}$

 

Exercise 3

Make a table of the interval of absolute stability for four one-step methods: Euler's method, Backward- Euler, M-Euler and Trapezoidal method.

Solution:

Methods	the interval
Euler	$-2<\lambda h<0$
Backward-Euler	$\lambda h<0$
M-Euler	$-2<\lambda h<0$
The trapezoidal method	$\lambda h<0$

 

Exercise 4

Find the Region of absolute stability of Adams-Bashforth explict Four-step Method

$w_{n+1}=w_{n}+(h/24)(55f_{n}-59f_{n-1}+37f_{n-2}-9f_{n-3})\,.$

Solution:

Applying Adams-Bashforth explict Four-step Method to the test equation $y'=\lambda y$ gives

$w_{n+1}=w_{n}+(\lambda h/24)(55w_{n}-59w_{n-1}+37w_{n-2}-9w_{n-3})\,.$

The characteristic polynominal of above method is

$Q(z,\lambda h)=z^{4}-z^{3}-h\lambda /24(55z^{3}-59z^{2}+37z-9)\,.$

The region R of absolute stability is $R=$$\{h\lambda \in \mathbb {C} ||z_{i}(h\lambda )|<1\}\,.$

 

Quiz

The following is a quiz covering information presented on the associated multistep method.

1 True or False: The multistep methods are always stable methods.

	TRUE.
	FALSE.

2 True or False: If the multistep method is strongly stable then it is weakly stable.

	TRUE.
	FALSE.

3 Check all that apply: Which of the following statements are right?...

	The root condition can always be satisfied for the multistep method.
	Methods that satisfy the root condition and have more than one distinct root with magnitude one are called strongly stable.
	Methods that do not satisfy the root condition are unstable.
	The Euler's method and the Backward Euler method have the same region of absolute stability.

4 Given the following ODE method

$y'=-e^{x}y+x+1,0\leq x\leq 1$

$y(0)=1$,

then which h make sure the absolute stability of the method.

	$h>0$
	$0<h<2/e$
	$0<h<e$
	$h>e$

References

• http://www.win.tue.nl/casa/meetings/seminar/previous/_abstract081001_files/multistepmethods_LeiLiu.pdf
• http://www.physics.arizona.edu/~restrepo/475B/Notes/source/node17.html
• http://www.siam.org/books/ot98/sample/OT98Chapter7.pdf