让神经网络在多个区域严格满足约束条件,且推理无额外开销。
mPOLICE: Provable Enforcement of Multi-Region Affine Constraints in Deep Neural Networks
- 为每个约束区域分配独立的神经元激活模式,实现局部仿射行为。
- 在强化学习、3D建模和流体模拟中均零约束违规,性能不下降。
- 适合对安全性和物理规律要求高的场景,如机器人与科学计算。
深度神经网络在机器人、科学建模等安全关键领域应用日益广泛,输出约束的严格遵守至关重要。现有针对单一凸区域的方法(如POLICE)扩展至多个不连通区域时,常导致约束违反或跨区域的非预期仿射行为。本文提出mPOLICE,一种可证明在多个不连通凸区域上强制仿射约束的新方法。其核心思想是为每个约束区域分配独特的神经元激活模式,实现局部仿射性并避免意外泛化。该方法通过逐层优化网络参数实现,并设计了训练算法,采用周期性符号模式约束,在任务性能与约束满足间取得平衡。实验验证了mPOLICE在安全关键强化学习、带几何约束的隐式3D形状表示及边界条件约束的流体动力学模拟中的有效性。重要的是,mPOLICE在推理阶段无运行时开销,是深度神经网络约束处理的实用可靠方案。
原文摘要 · Abstract (English)
Deep neural networks are increasingly used in safety-critical domains such as robotics and scientific modeling, where strict adherence to output constraints is essential. Methods like POLICE, which are tailored for single convex regions, face challenges when extended to multiple disjoint regions, often leading to constraint violations or unwanted affine behavior across regions. This paper proposes mPOLICE, a new approach that generalizes POLICE to provably enforce affine constraints over multiple disjoint convex regions. At its core, mPOLICE assigns distinct neuron activation patterns to each constrained region, enabling localized affine behavior and avoiding unintended generalization. This is implemented through a layer-wise optimization of the network parameters. Additionally, we introduce a training algorithm that incorporates mPOLICE into conventional deep learning pipelines, balancing task-specific performance with constraint enforcement using periodic sign pattern enforcement. We validate the flexibility and effectiveness of mPOLICE through experiments across various applications, including safety-critical reinforcement learning, implicit 3D shape representation with geometric constraints, and fluid dynamics simulations with boundary condition enforcement. Importantly, mPOLICE incurs no runtime overhead during inference, making it a practical and reliable solution for constraint handling in deep neural networks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。