arXiv:2502.06774cs.LG2025-02被引 19

让神经网络精准满足非线性约束,提升安全与精度。

ENFORCE: Nonlinear Constrained Learning with Adaptive-depth Neural Projection

  • 用自适应投影模块动态处理非线性约束
  • 在多个任务中实现约束误差小于预设容忍度ε
  • 适合需严格约束的工程优化与高可靠性场景

确保神经网络遵守领域特定约束对保障安全性和可信度至关重要,同时可提升推理精度。尽管大多数实际任务具有非线性特性,现有方法多局限于仿射(等式)或凸(不等式)约束。本文提出ENFORCE,一种基于自适应神经投影模块(AdaNP)的神经网络架构,可在指定容差ε内精确满足非线性等式与不等式约束,且在仿射-关于y的情况下可精确满足。针对仿射约束集,证明其投影映射为非扩张(1-Lipschitz),保障梯度传播稳定;针对非线性约束,在标准正则条件下建立局部收敛性分析。我们在函数拟合、真实工程案例及优化问题学习等多个任务上评估了ENFORCE。针对后者,引入一类可扩展的优化问题作为非线性约束学习基准。在基准测试中,该架构预测结果在容差ε内满足非线性等式与不等式约束,且训练与推理阶段均保持可扩展的计算复杂度。

原文摘要 · Abstract (English)

Ensuring neural networks adhere to domain-specific constraints is crucial for addressing safety and trustworthiness while also enhancing inference accuracy. Despite the nonlinear nature of most real-world tasks, the majority of existing methods are limited to affine (equality) or convex (inequality) constraints. We introduce ENFORCE, a neural network architecture that uses an adaptive projection module (AdaNP) to enforce nonlinear equality and inequality constraints in the predictions up to a specified tolerance $\varepsilon$, and exactly in the affine-in-$y$ case. For affine constraint sets, we prove that the associated projection mapping is non-expansive (1-Lipschitz), ensuring stable gradient propagation. For nonlinear constraints, we establish local convergence analysis under standard regularity conditions. We evaluate ENFORCE on multiple tasks, including function fitting, real-world engineering case studies, and learning optimization problems. For the latter, we introduce a class of scalable optimization problems as a benchmark for nonlinear constrained learning. In the benchmarks, the predictions of our architecture satisfy nonlinear equality and inequality constraints up to a prescribed tolerance $\varepsilon$, while maintaining scalability with tractable computational complexity at training and inference time.

约束学习神经网络优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。