A conjugate gradient (CG)-type algorithm CG Plan is introduced for calculating an approximate solution of Newton’s equation within large-scale optimization frameworks. The approximate solution must satisfy suitable properties to ensure global convergence. In practice, the CG algorithm is widely used, but it is not suitable when the Hessian matrix is indefinite, as it can stop prematurely. CG Plan is a symmetric variant of the composite step Bi-CG method of Bank and Chan, suitably adapted for optimization problems. It is an alternative to CG that copes with the indefinite case. We showconvergence for CG Plan, then prove that the practical implementation always provides a gradient related direction within a truncated Newton method (algorithm TN_Plan). Some preliminary numerical results support the theory.
Conjugate Gradient (CG)-type Method for the Solution of Newton's equation within Optimization Frameworks
FASANO, Giovanni
2004-01-01
Abstract
A conjugate gradient (CG)-type algorithm CG Plan is introduced for calculating an approximate solution of Newton’s equation within large-scale optimization frameworks. The approximate solution must satisfy suitable properties to ensure global convergence. In practice, the CG algorithm is widely used, but it is not suitable when the Hessian matrix is indefinite, as it can stop prematurely. CG Plan is a symmetric variant of the composite step Bi-CG method of Bank and Chan, suitably adapted for optimization problems. It is an alternative to CG that copes with the indefinite case. We showconvergence for CG Plan, then prove that the practical implementation always provides a gradient related direction within a truncated Newton method (algorithm TN_Plan). Some preliminary numerical results support the theory.File | Dimensione | Formato | |
---|---|---|---|
goms041013.pdf
non disponibili
Tipologia:
Documento in Pre-print
Licenza:
Licenza non definita
Dimensione
190.52 kB
Formato
Adobe PDF
|
190.52 kB | Adobe PDF | Visualizza/Apri |
I documenti in ARCA sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.