Journal of the Operations Research Society of China ›› 2024, Vol. 12 ›› Issue (2): 265-297.doi: 10.1007/s40305-022-00439-z

    Next Articles

The Rate of Convergence of Augmented Lagrangian Method for Minimax Optimization Problems with Equality Constraints

Yu-Hong Dai1, Li-Wei Zhang2   

  1. 1 LSEC, ICMSEC, AMSS, Chinese Academy of Sciences, Beijing 100190, China;
    2 Institute of Operations Research and Control Theory, School of Mathematical Sciences, Dalian University of Technology, Dalian 116024, China
  • Received:2021-08-29 Revised:2022-07-05 Online:2024-06-30 Published:2024-06-12
  • Contact: Li-Wei Zhang, Yu-Hong Dai E-mail:lwzhang@dlut.edu.cn;dyh@lsec.cc.ac.cn
  • Supported by:
    This work was supported by the National Natural Science Foundation of China (Nos. 11991020, 11631013, 11971372, 11991021, 11971089 and 11731013), the Strategic Priority Research Program of Chinese Academy of Sciences (No. XDA27000000) and Dalian High-Level Talent Innovation Project (No. 2020RD09).

Abstract: The augmented Lagrangian function and the corresponding augmented Lagrangian method are constructed for solving a class of minimax optimization problems with equality constraints. We prove that, under the linear independence constraint qualification and the second-order sufficiency optimality condition for the lower level problem and the second-order sufficiency optimality condition for the minimax problem, for a given multiplier vector μ, the rate of convergence of the augmented Lagrangian method is linear with respect to ||μ - μ*|| and the ratio constant is proportional to 1/c when the ratio ||μ - μ*/c is small enough, where c is the penalty parameter that exceeds a threshold c* > 0 and μ* is the multiplier corresponding to a local minimizer. Moreover, we prove that the sequence of multiplier vectors generated by the augmented Lagrangian method has at least Q-linear convergence if the sequence of penalty parameters {ck} is bounded and the convergence rate is superlinear if {ck} is increasing to infinity. Finally, we use a direct way to establish the rate of convergence of the augmented Lagrangian method for the minimax problem with a quadratic objective function and linear equality constraints.

Key words: Minimax optimization, Augmented Lagrangian method, Rate of convergence, Second-order sufficiency optimality

CLC Number: