用可学习的神经网络加速求解带约束优化问题
Unrolled Neural Networks for Constrained Optimization
- 构建双神经网络联合逼近拉格朗日鞍点,模拟对偶上升动态
- 在混合整数二次规划与无线网络功率分配中达近优近可行解
- 支持分布外泛化,适合需要快速求解约束问题的场景
本文提出一种称为约束对偶展开(CDU)的框架,用于求解带约束优化问题。该框架由两个耦合的神经网络组成,共同逼近拉格朗日函数的鞍点。主网络模拟迭代优化器,在给定对偶乘子下寻找拉格朗日的驻点,乘子采样自未知分布;对偶网络通过多层生成最优乘子轨迹,并在每层调用主网络。与标准展开不同,通过施加主变量下降和对偶变量上升的约束,显式诱导对偶上升动力学。将两网络训练建模为嵌套优化问题,提出交替更新策略,缓解主网络训练中乘子分布不确定性。在混合整数二次规划(MIQPs)和无线网络功率分配任务中进行数值评估,结果表明方法能获得近优近可行解,并表现出强分布外(OOD)泛化能力。
原文摘要 · Abstract (English)
In this paper, we develop unrolled neural networks to solve constrained optimization problems, offering accelerated, learnable counterparts to dual ascent (DA) algorithms. Our framework, termed constrained dual unrolling (CDU), comprises two coupled neural networks that jointly approximate the saddle point of the Lagrangian. The primal network emulates an iterative optimizer that finds a stationary point of the Lagrangian for a given dual multiplier, sampled from an unknown distribution. The dual network generates trajectories towards the optimal multipliers across its layers while querying the primal network at each layer. Departing from standard unrolling, we induce DA dynamics by imposing primal-descent and dual-ascent constraints through constrained learning. We formulate training the two networks as a nested optimization problem and propose an alternating procedure that updates the primal and dual networks in turn, mitigating uncertainty in the multiplier distribution required for primal network training. We numerically evaluate the framework on mixed-integer quadratic programs (MIQPs) and power allocation in wireless networks. In both cases, our approach yields near-optimal near-feasible solutions and exhibits strong out-of-distribution (OOD) generalization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。