TY - JOUR
T1 - Inexact proximal memoryless quasi-Newton methods based on the Broyden family for minimizing composite functions
AU - Nakayama, Shummin
AU - Narushima, Yasushi
AU - Yabe, Hiroshi
N1 - Funding Information:
This research was supported in part by JSPS KAKENHI (Grant Numbers 18K11179, 20K11698 and 20K14986) and the Research Institute for Mathematical Sciences in Kyoto University.
Publisher Copyright:
© 2021, The Author(s), under exclusive licence to Springer Science+Business Media, LLC part of Springer Nature.
PY - 2021/5
Y1 - 2021/5
N2 - This study considers a proximal Newton-type method to solve the minimization of a composite function that is the sum of a smooth nonconvex function and a nonsmooth convex function. In general, the method uses the Hessian matrix of the smooth portion of the objective function or its approximation. The uniformly positive definiteness of the matrix plays an important role in establishing the global convergence of the method. In this study, an inexact proximal memoryless quasi-Newton method is proposed based on the memoryless Broyden family with the modified spectral scaling secant condition. The proposed method inexactly solves the subproblems to calculate scaled proximal mappings. The approximation matrix is shown to retain the uniformly positive definiteness and the search direction is a descent direction. Using these properties, the proposed method is shown to have global convergence for nonconvex objective functions. Furthermore, the R-linear convergence for strongly convex objective functions is proved. Finally, some numerical results are provided.
AB - This study considers a proximal Newton-type method to solve the minimization of a composite function that is the sum of a smooth nonconvex function and a nonsmooth convex function. In general, the method uses the Hessian matrix of the smooth portion of the objective function or its approximation. The uniformly positive definiteness of the matrix plays an important role in establishing the global convergence of the method. In this study, an inexact proximal memoryless quasi-Newton method is proposed based on the memoryless Broyden family with the modified spectral scaling secant condition. The proposed method inexactly solves the subproblems to calculate scaled proximal mappings. The approximation matrix is shown to retain the uniformly positive definiteness and the search direction is a descent direction. Using these properties, the proposed method is shown to have global convergence for nonconvex objective functions. Furthermore, the R-linear convergence for strongly convex objective functions is proved. Finally, some numerical results are provided.
KW - Broyden family
KW - Global and local convergence properties
KW - Inexact proximal method
KW - Memoryless quasi-Newton method
KW - Nonsmooth optimization
KW - Proximal Newton-type method
UR - http://www.scopus.com/inward/record.url?scp=85100557156&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85100557156&partnerID=8YFLogxK
U2 - 10.1007/s10589-021-00264-9
DO - 10.1007/s10589-021-00264-9
M3 - Article
AN - SCOPUS:85100557156
SN - 0926-6003
VL - 79
SP - 127
EP - 154
JO - Computational Optimization and Applications
JF - Computational Optimization and Applications
IS - 1
ER -