提出可端到端训练的非线性约束强化方法,确保神经网络输出严格满足复杂约束。
HardNet++: Nonlinear Constraint Enforcement in Neural Networks
- 通过迭代局部线性化调整输出,实现对非线性约束的硬性满足
- 在模型预测控制任务中实现约束精准满足且不损失优化性能
- 适用于无有效投影映射的复杂约束场景,适合安全关键系统
在控制与决策应用中,确保神经网络输出满足约束对安全性、可靠性及物理真实性至关重要。软约束方法虽在训练中惩罚违反行为,但无法保证推理时的约束满足;其他方法通过投影层保障约束,但依赖可行集上存在可计算投影,限制了其在一般问题中的应用。许多实际问题具有非线性特征且缺乏特殊结构以支持有效投影,亟需通用非线性约束强制方法。为此,本文提出 HardNet++,一种能处理线性与非线性等式及不等式约束的方法。该方法通过阻尼局部线性化迭代调整网络输出,每次迭代可微,支持端到端训练,约束满足层在训练中持续激活。在特定正则条件下,该过程可将非线性约束满足度控制至任意精度。实验表明,在学习优化框架下,该方法能在不损失最优性的前提下实现紧约束遵守,应用于非线性模型预测控制任务。
原文摘要 · Abstract (English)
Enforcing constraint satisfaction in neural network outputs is critical for safety, reliability, and physical fidelity in many control and decision-making applications. While soft-constrained methods penalize constraint violations during training, they do not guarantee constraint adherence during inference. Other approaches guarantee constraint satisfaction via a projection layer, but often rely on the existence of a tractable projection onto the feasible set, limiting their utility in more general problem settings. Many real-world problems of interest are nonlinear and lack the special structure admitting a tractable projection, motivating the development of methods that can enforce general nonlinear constraints. To this end, we introduce HardNet++, a constraint-satisfaction method that enforces linear and nonlinear equality and inequality constraints. Our approach iteratively adjusts the network output via damped local linearizations of the constraints. Each iteration is differentiable, admitting an end-to-end training framework, where the constraint satisfaction layer is active during training. We show that under certain regularity conditions, this procedure enforces nonlinear constraint satisfaction to arbitrary tolerance. Finally, we demonstrate tight constraint adherence without loss of optimality in a learning-for-optimization context, where we apply this method to a nonlinear model predictive control problem.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。