A Dynamic Alternating Direction of Multipliers for Nonconvex Minimization with Nonlinear Functional Equality Constraints

This paper studies the minimization of a broad class of nonsmooth nonconvex objective functions subject to nonlinear functional equality constraints, where the gradients of the differentiable parts in the objective and the constraints are only locally Lipschitz continuous. We propose a specific prox...

Full description

Saved in:
Bibliographic Details
Published in:Journal of optimization theory and applications 2022-06, Vol.193 (1-3), p.324-353
Main Authors: Cohen, Eyal, Hallak, Nadav, Teboulle, Marc
Format: Article
Language:English
Subjects:
Algorithms
Applications of Mathematics
By products
Calculus of Variations and Optimal Control
Optimization
Convergence
Critical point
Engineering
Functionals
Mathematics
Mathematics and Statistics
Methods
Multipliers
Operations Research/Decision Theory
Optimization
Parameters
Sparsity
Theory of Computation
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This paper studies the minimization of a broad class of nonsmooth nonconvex objective functions subject to nonlinear functional equality constraints, where the gradients of the differentiable parts in the objective and the constraints are only locally Lipschitz continuous. We propose a specific proximal linearized alternating direction method of multipliers in which the proximal parameter is generated dynamically, and we design an explicit and tractable backtracking procedure to generate it. We prove subsequent convergence of the method to a critical point of the problem, and global convergence when the problem’s data are semialgebraic. These results are obtained with no dependency on the explicit manner in which the proximal parameter is generated. As a byproduct of our analysis, we also obtain global convergence guarantees for the proximal gradient method with a dynamic proximal parameter under local Lipschitz continuity of the gradient of the smooth part of the nonlinear sum composite minimization model.
ISSN:0022-3239
1573-2878
DOI:10.1007/s10957-021-01929-5