Newton's Method In Optimization

Newton's method is a well-known algorithm for finding roots of equations in one or more dimensions. It can be used to find local maxima and local minima of functions by noticing that if a real number x* is a stationary point of a function f(x), then x* is a root of the derivative f'(x), and therefore one can apply Newton's method to f'(x). Thus, provided that f(x) is a twice differentiable function and the initial guess x_0 is chosen close enough to x*, the sequence (x_n) defined by
x_{n+1} = x_n - \frac{f'(x_n)}{f''(x_n)}, \ n \ge 0
will converge towards x*. This iterative scheme can be generalized to several dimensions by replacing the derivative with the gradient, \nabla f(\mathbf{x}), and the reciprocal of the second derivative with the inverse of the Hessian matrix, H f(\mathbf{x}). One obtains the iterative scheme
\mathbf{x}_{n+1} = \mathbf{x}_n - f(\mathbf{x}_n)^{-1} \nabla f(\mathbf{x}_n), \ n \ge 0.
Usually Newton's method is modified to include a small step size \gamma>0 instead of \gamma=1
\mathbf{x}_{n+1} = \mathbf{x}_n - \gammaf(\mathbf{x}_n)^{-1} \nabla f(\mathbf{x}_n).
The geometric interpretation of Newton's method is that at each iteration one approximates f(\mathbf{x}) by a quadratic function around \mathbf{x}_n, and then takes a step towards the maximum/minimum of this quadratic function. Newton's method converges much faster towards a local maximum or minimum than gradient descent. However, to use Newton's method one needs to know the Hessian of f(\mathbf{x}), which sometimes can be difficult to compute. There exist various quasi-Newton methods, where an approximation for the Hessian is used instead. Another drawback of Newton's method is that finding the inverse of the Hessian could be an expensive operation.

See also

Gradient descent, Gauss-Newton algorithm, Optimization.

References

  • Nocedal, Jorge & Wright, Stephen J. (1999). Numerical Optimization. Springer-Verlag. ISBN 0387987932.

 

<< PreviousWord BrowserNext >>
julie benz
aribo of austria
vans rv 4
odes of solomon
tea party
emil skoda
gas balloon
framing (construction)
rotary wing aircraft
mazdeans
toyota t100
berber music
job migration
nuuanu pali
cheval blanc
francisco scaramanga
winimages
aeolian harmony
dhyan chohans
sculptor dwarf galaxy
action of 20 september 1698
nebitdag
harmony (album)
radisson hotels & resorts
action of 22 august 1696
gebers
dark winter
algebra bundle
genii
might is right
dunkeld
seven separate fools
sadao watanabe (musician)
highland (geographic feature)
sadao watanabe
eka
mot test
the devil's notebook
gossain
mike bellotti
around the world with three dog night
shifter
benjamin piatt runkle
aahla