自适应调整多约束优化中的惩罚参数,提升ADMM收敛速度。
An Adaptive Multiparameter Penalty Selection Method for Multiconstraint and Multiblock ADMM
- 为每类约束引入独立惩罚参数,动态调节以匹配尺度差异
- 实验显示收敛速度优于现有多种参数选择方法
- 适合处理多约束、块矩阵结构的优化问题
本文提出一种用于多约束或具有块矩阵结构函数的交替方向乘子法(ADMM)的在线多惩罚参数选择新方法。传统ADMM常使用单一惩罚参数,但在多约束问题中,由于约束间尺度差异,即使调参也常导致收敛缓慢。该方法通过为每个约束引入独立惩罚参数,自适应地补偿尺度差异,从而提升收敛性并增强对问题变换和初始参数选择的鲁棒性。方法设计简单,易于实现。数值实验表明,该方法在多种场景下均优于现有惩罚参数选择策略。
原文摘要 · Abstract (English)
This work presents a new method for online selection of multiple penalty parameters for the alternating direction method of multipliers (ADMM) algorithm applied to optimization problems with multiple constraints or functionals with block matrix components. ADMM is widely used for solving constrained optimization problems in a variety of fields, including signal and image processing. Implementations of ADMM often utilize a single hyperparameter, referred to as the penalty parameter, which needs to be tuned to control the rate of convergence. However, in problems with multiple constraints, ADMM may demonstrate slow convergence regardless of penalty parameter selection due to scale differences between constraints. Accounting for scale differences between constraints to improve convergence in these cases requires introducing a penalty parameter for each constraint. The proposed method is able to adaptively account for differences in scale between constraints, providing robustness with respect to problem transformations and initial selection of penalty parameters. It is also simple to understand and implement. Our numerical experiments demonstrate that the proposed method performs favorably compared to a variety of existing penalty parameter selection methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。