Exploiting Band Structure in Unconstrained Optimization Without Derivatives

Keywords

Hessian matrix, Computer science, Interpolation (computer graphics), Financial engineering, Mathematical optimization

References

• On the convergence of derivative-free methods for unconstrained optimizationAndy Conn, Katya Scheinberg, Philippe L. Toint — 1997
• Trust Region MethodsAndrew R. Conn, Nicholas I. M. Gould, Philippe L. Toint — 2000
• Numerical methods for unconstrained optimization and nonlinear equationsJ. E. Dennis, Robert B. Schnabel — 1983
• Table errata: Algorithms for minimization without derivatives (Prentice-Hall, Englewood Cliffs, N. J., 1973)Richard P. Brent — 1975
• Recent progress in unconstrained nonlinear optimization without derivativesAndrew R. Conn, Katya Scheinberg, Philippe L. Toint — 1997
• On the accelerating property of an algorithm for function minimization without calculating derivativesF. M. Calliee, Philippe L. Toint — 1978
• A trust-region framework for managing the use of approximation models in optimizationNatalia Alexandrov, J. E. Dennis, Robert Michael Lewis — 1997
• A surrogate-model-based method for constrained optimizationCharles Audet, J. Denni, Douglas Moore — 2000
• A Modification of Davidon's Minimization Method to Accept Difference Approximations of DerivativesG. W. Stewart — 1967
• On the Lagrange functions of quadratic models that are defined by interpolation*M. J. D. Powell — 2001
• Algorithms for minimization without derivativesD. Anderson — 1974
• On multivariate Lagrange interpolationThomas Sauer, Yuan Xu — 1995
• Function Minimization by Interpolation in a Data TableDavid H. Winfield — 1973
• A derivative free optimization algorithm in practiceAndrew R. Conn, Katya Scheinberg, Philippe L. Toint — 1998
• Wedge trust region methods for derivative free optimizationMarcelo Marazzi, Jorge Nocedal — 2002
• An efficient method for finding the minimum of a function of several variables without calculating derivativesM. J. D. Powell — 1964
• Sequential Application of Simplex Designs in Optimisation and Evolutionary OperationW. Spendley, G. R. Hext, F. R. Himsworth — 1962
• A Method for Minimizing a Sum of Squares of Non-Linear Functions Without Calculating DerivativesM. J. D. Powell — 1965
• `` Direct Search'' Solution of Numerical and Statistical ProblemsRobert Hooke, T. A. Jeeves — 1961
• A Simplex Method for Function MinimizationJ. A. Nelder, R. Mead — 1965

Cited by

• Une méthode de région de confiance avec ensemble actif pour l'optimisation non linéaire sans dérivées avec contraintes de bornes appliquée à des problèmes aérodynamiques bruitésAnke Tröltzsch — 2011
• Derivative Free Surrogate Optimization for Mixed-Integer Nonlinear Black Box Problems in EngineeringThomas Hemker — 2010
• Exploiting problem structure in pattern search methods for unconstrained optimizationC. J. Price, Philippe L. Toint — 2006
• On convergence analysis of a derivative-free trust region algorithm for constrained optimization with separable structureDan Xue, Wenyu Sun — 2013
• A hybrid Hooke and Jeeves|Direct method for non-smooth optimization.C. J. Price, B. L. Robertson, Marco Reale — 2009
• On Curvature and Separability in Unconstrained OptimisationLennart Frimannslund — 2006
• Self-Correcting Geometry in Model-Based Algorithms for Derivative-Free Unconstrained OptimizationKatya Scheinberg, Philippe L. Toint — 2010
• Optimizing partially separable functions without derivativesBenoît Colson, Philippe L. Toint — 2005
• Survey of trust-region derivative free optimization methodsBülent Karasözen — 2007
• Derivative-free optimization methodsJeffrey Larson, Matt Menickelly, Stefan M. Wild — 2019
• Global and local information in structured derivative free optimization with BFOMargherita Porcelli, Philippe L. Toint — 2020
• Survey of derivative-free optimizationMin Xi, Wenyu Sun, Jun Chen — 2020
• Exploiting Problem Structure in Derivative Free OptimizationMargherita Porcelli, Philippe L. Toint — 2022
• The role of airspeed variability in fixed-time, fuel-optimal aircraft trajectory planningCathie A. Wells, Dante Kalise, Nancy Nichols — 2022
• A Model-Based Derivative-Free Optimization Algorithm for Partially Separable ProblemsLiu, Yichuan, Li, Yingzhou — 2025
• Conjunctive Bayesian Optimization (conBO): An Application to Cyber-Physical Systems Verification with Conjunctive RequirementsSurdeep Chotaliya, Tanmay Khandait, Giulia Pedrielli — 2026
• Optimization Methods and SoftwareC. Price, P. Toint — 2006
• A Derivative-Free Algorithm for Sparse Unconstrained Optimization ProblemsB. Colson, P. Toint — 2002
• Direct Search MethodsR. Lewis, V. Torczon — 2011
• Trust-region algorithms for derivative-free optimization and nonlinear bilevel programmingColson, Benoit — 2004

Related papers

• Higher-accuracy schemes for approximating the Hessian from electronic structure calculations in chemical dynamics simulations.Heng Wu, Mohd Rosdzimin Abdul Rahman, Jianchun Wang — 2010
• On the connection between WRI and FWI: Analysis of the nonlinear term in the Hessian matrixAli Gholami, Hossein S. Aghamiry, S. Operto — 2022
• Adjoint based Hessian evaluation for SPN modeled optical tomographyNishigandha Patil, Naren Naik — 2018
• Improved Hessian estimation for adaptive random directions stochastic approximationD. Sai Koti Reddy, L. A. Prashanth, Shalabh Bhatnagar — 2016
• Improved Pseudo-hessian for Frequency-domain Elastic Waveform InversionJu‐Won Oh, Dong Joon Min — 2012
• Use of prismatic waves in full-waveform inversion with the exact HessianYuzhu Liu, Zheng Wu, Hao Kang — 2020
• Financial Engineering: A Handbook of Derivative ProductsJ. N. Robinson, DeRoy C. Thomas, S. Eckl — 1991