Marquardt Extended Technique for Solving Unconstrained Optimization Problems
Saad Shakir Mahmood, Jaafer Hmood Eidi, Haydir Ali Hassan
Abstract
Open-access reader
Saad Shakir Mahmood, Jaafer Hmood Eidi, Haydir Ali Hassan
Abstract
Open-access reader
Abstract The objective of this article is to solve the unconstrained optimization problem by using Marquardt method together with MQ-N (modified quasi-Newton) method. The Hessian matrix will be computed numerically by using modified Broyden-Flechert-Goldfarb-Shanno (BFGS) update ( H-version) after convert it to the B-version by using Sherman-Morisson-Woodburge (SMW) formula which guarantee the two important properties SPD (symmetric and positive definite), and hence the exact second derivative of OF (objective function) does not be needed to compute. The line search technique is very important to accelerate the method to terminate at the minimum value of OF, so in this article the line search technique is instead by used the search technique of Marquardt method together with MQ-N method (especially modified BFGS method where the step size is equal one) to solve the unconstrained optimization problem. Test problems are solved by Matlab software to prove the effective of this new technique so called the Marquardt extended technique (MET).
A significance statement is not available in the OpenAlex record.
A contribution statement is not available in the OpenAlex record.
Method details are not available in the OpenAlex metadata.
Findings are not separately available in the OpenAlex metadata.
Limitations are not available in the OpenAlex metadata.
Application details are not available in the OpenAlex metadata.
Abstract The objective of this article is to solve the unconstrained optimization problem by using Marquardt method together with MQ-N (modified quasi-Newton) method. The Hessian matrix will be computed numerically by using modified Broyden-Flechert-Goldfarb-Shanno (BFGS) update ( H-version) after convert it to the B-version by using Sherman-Morisson-Woodburge (SMW) formula which guarantee the two important properties SPD (symmetric and positive definite), and hence the exact second derivative of OF (objective function) does not be needed to compute. The line search technique is very important to accelerate the method to terminate at the minimum value of OF, so in this article the line search technique is instead by used the search technique of Marquardt method together with MQ-N method (especially modified BFGS method where the step size is equal one) to solve the unconstrained optimization problem. Test problems are solved by Matlab software to prove the effective of this new technique so called the Marquardt extended technique (MET).
Key concepts: Broyden–Fletcher–Goldfarb–Shanno algorithm, Hessian matrix, Quasi-Newton method, Line search, MATLAB, Mathematical optimization, Matrix (chemical analysis), Computer science