numerical stability

In the mathematical subfield of numerical analysis, numerical stability is a property of numerical algorithms. It describes how errors in the input data propagate through the algorithm. In a stable method, the errors due to the approximations get damped out as the computation proceeds. In an unstable method, any errors in processing get magnified as the calculation proceeds. Unstable methods quickly generate garbage and are useless for numerical processing. The numerical stability of a method together with the condition number defines how good a result we can get when using approximated methods to calculate a certain mathematical problem. Sometimes a single calculation can be achieved in several ways, all of which are algebraically identically in terms of ideal real or complex numbers, but in practice yield different results as they have different levels of numerical stability. One of the common tasks of numerical analysis is to try to select algorthms which are robust -- that is to say, have good numerical stability in a wide range of situations. These methods are often made available to users of programming languages as mathematical computing libraries. The appropriate use of mathematical computing libraries is usually far superior to "roll you own" numerical algorithms.

Definition

Given an algorithm f(x), with x the input data and ε the error in the input data, we say the algorithm is numerically stable for the relative error if

x - (x + \epsilon) \simeq f(x) - f(x + \epsilon)

and numerically stable for the absolute error if

\frac{x - (x + \epsilon)}{x} \simeq \frac{f(x) - f(x + \epsilon)}{f(x)}

We say an algorithm is numerically unstable if

x - (x + \epsilon) << f(x) - f(x + \epsilon)\

and numerically unstable for the absolute error if

\frac{x - (x + \epsilon)}{x} << \frac{f(x) - f(x + \epsilon)}{f(x)}

Notes

In calculating numerical solutions to certain partial differential equations, stability is sometimes achieved by including numerical diffusion. Numerical diffusion is a mathematical term which insures that roundoff and other errors in the calculation get spread out and do not add up to cause the calculation to "blow up". Numerical stability is the reason why you usually can't test a numerical code such as a climate simulation by running it backward. Running the code forward includes numerical methods to insure that the random approximation errors become less and less important as the calculation proceed insuring numerical stability. Running the code backward causes those mechanisms to magnify those errors generating useless results. When solving a numerical problem with an approximated method, two types of errors can occur:

Truncation errors: One can only make a finite number of calculations. Examples: calculating a transcendental function using its Taylor expansion, integrating using a sum of finite rectangles.
Roundoff errors: Certain numbers need an infinite number of digits to be represented (pi), when rounding these numbers the roundoff errors will propagate through the calculation.

<< Previous

Word Browser

Next >>

camas potholes
lacamas lake
list of all two letter combinations
rsunda stadium
camp taliaferro
aik
essex, massachusetts
symphony no. 4 (brahms)
acrylonitrile butadiene styrene
power macintosh g3
karlheinz brandenburg

william cavendish, 1st duke of devonshire
william cavendish, 2nd duke of devonshire
anna santisteban
qfs pen
julius caesar aranzi
william cavendish, 3rd duke of devonshire
water slide
william cavendish, 4th duke of devonshire
william cavendish, 5th duke of devonshire
william cavendish, 6th duke of devonshire
william cavendish, 7th duke of devonshire

frchet space
wantage
spencer cavendish, 8th duke of devonshire
history of anatomy in the 17th and 18th centuries
victor cavendish, 9th duke of devonshire
constantio varoli
edward cavendish, 10th duke of devonshire
andrew cavendish, 11th duke of devonshire
mayra santos febres
spine (biology)
hieronymus fabricius

vincent massey
melungeon
ambisonics
linux journal
hms zebra
willie blount
playground
thomas howard, 2nd duke of norfolk
uss dubuque (lpd 8)
thomas howard, 3rd duke of norfolk
chanter