Eigenvalue Algorithm

In linear algebra, one of the most important problems is designing efficient and stable algorithms for finding the eigenvalues of a matrix. These eigenvalue algorithms may also find eigenvectors.

Characteristic polynomial

The usual method for finding the eigenvalues of a small matrix is by using the characteristic polynomial. The characteristic polynomial, defined as det(A - \lambda I), is a polynomial in \lambda whose roots are the eigenvalues of A. Unfortunately, this method has some limitations. A general polynomial of order n > 4 cannot be solved by a finite sequence of arithmetic operations and radicals (See Abel-Ruffini theorem). There exist efficient root-finding algorithms for higher order polynomials. However, finding the roots of the characteristic polynomial may be an ill-conditioned problem even when the underlying eigenvalue problem is well-conditioned. For this reason, this method is rarely used. The above discussion implies a restriction on all eigenvalue algorithms. It can be shown that for any polynomial, there exists a matrix (see companion matrix) having that polynomial as its characteristic polynomial (actually, there are infinitely many). If there did exist a finite sequence of arithmetic operations for exactly finding the eigenvalues of a general matrix, this would provide a corresponding finite sequence for general polynomials, in contradiction of the Abel-Ruffini theorem. Therefore, general eigenvalue algorithms are expected to be iterative.

Power iteration

The basic idea of this method is choosing an initial vector b (either an eigenvector approximation or a random vector) and iteratively calculating Ab, A^{2}b, A^{3}b,.... Except for a set of zero measure, for any initial vector, the result will converge to an eigenvector corresponding to the dominant eigenvalue. In practice, the vector should be normalized after every iteration. By itself, power iteration is not very useful. Its convergence is slow except for special cases of matrices, and without modification, it can only find the largest or dominant eigenvalue (and the corresponding eigenvector). However, we can understand a few of the more advanced eigenvalue algorithms as variations of power iteration. In addition, some of the better algorithms for the generalized eigenvalue problem are based on power iteration. This method can in general be quite slow. It is especially slow if there is an eigenvalue close in magnitude to the dominant eigenvalue.

Advanced methods

More advanced methods of finding eigenvalues include: Most eigenvalue algorithms rely on first reducing the matrix A to Hessenberg or tridiagonal form. This is usually accomplished via projections.

 

<< PreviousWord BrowserNext >>
bobby baccilieri
quebec general election, 1892
william bryant
timothy bloodworth
hyundai engineering and construction
francis locke
willie person mangum
robert strange
raiden
william henry haywood, jr.
the lord of the rings (1981 radio series)
chung ju yung
live in sin
usipetes
george edmund badger
museum of flight
incident photon
table of lunar month correspondences
asa biggs
thomas lanier clingman
alessandro dos santos
peoria rivermen
altera
joseph carter abbott
matt whitaker ransom
marion butler
furnifold mclendel simmons
john m. fabian
nba live series
disc dog
daniel brandenstein
josiah william bailey
sitiveni rabuka
triple play series
serbian people's party of montenegro
ncaa march madness series
william e. thornton
filter fluorometer
patsy parisi
blackburn roc
electron excitation
frank porter graham
nassau coliseum
willis smith