Linesearch

In (unconstrained) optimization, the linesearch strategy is one of two basic iterative approaches to finding a local minimum \mathbf{x}^* of an objective function f:\mathbb R^n\to\mathbb R. The other method is that of trust regions.

Algorithm

i) Set iteration counter k=0, and make an initial guess, \mathbf{x}_0 for the minimum.
ii) Compute a descent direction \mathbf{p}_k.
iii) Choose \alpha_k to 'loosely' minimize \phi(\alpha)=f(\mathbf{x}_k+\alpha\mathbf{p}_k) over \alpha\in\mathbb R.
iv) Update \mathbf{x}_{k+1}=\mathbf{x}_k+\alpha_k\mathbf{p}_k, k=k+1.
If \|\nabla f(\mathbf{x}_k)\|\leqtolerance, STOP.
Else, goto ii).
In step iii) we can either exactly minimize \phi, by solving \phi'(\alpha_k)=0, or loosely, by asking for a sufficient decrease in \phi. The latter may be performed in a number of ways, perhaps by doing a backtracking linesearch or using the Wolfe conditions. Like other optimization methods, line search may be combined with simulated annealing to allow it to jump over some local minima.

Reference

N. I. M. Gould and S. Leyffer, An introduction to algorithms for nonlinear optimization. In J. F. Blowey, A. W. Craig, and T. Shardlow, Frontiers in Numerical Analysis, pages 109-197. Springer Verlag, Berlin, 2003.

 

<< PreviousWord BrowserNext >>
resistance seam welding
steve avery
resistance welding
minque
chief powhatan
woodside park tube station
alfa romeo brera
foster hewitt memorial award
alfa romeo 159
bawm
alfa romeo kamal
tomalley
tempo reale
river calder (disambiguation)
alfa romeo spyder
electric honey (album)
nothern line effect
santiago sierra
milton shapp
electric honey (label)
ilioupoli
susan constant
porsche cayman
heijo palace
diagramming sentences
rzeczpospolita
richard fiedler
list of bridges in singapore
sherry shriner
remich
godspeed (ship)
principal triangulation of great britain
voltage regulator tube
hell o
burry holms
ian robb
antonin puc
swing trading
scumdogs of the universe
hold up problem
george strother gaines
v.c. eendracht aalst 2002
jamestown 2007
taimur bin feisal