arXiv:2505.13858cs.LG2025-05NeurIPS被引 12

让深度模型输出自动满足硬性约束,无需迭代优化

Enforcing Hard Linear Constraints in Deep Learning Models with Decision Rules

  • 用决策规则构建安全子网络,确保输出始终满足线性约束
  • 输出为两个子网络的凸组合,在测试时100%满足约束条件
  • 适用于需要严格合规的场景,如物理仿真、公平性保障

深度学习模型在安全关键任务中越来越重要,其预测必须满足硬性约束,如物理规律、公平性要求或安全限值。但标准架构缺乏内置机制来强制执行这些约束,现有基于正则化或投影的方法通常仅适用于简单约束,计算成本高,且缺乏可行性保证。本文提出一种模型无关的框架,用于在神经网络输出上施加依赖输入的线性等式与不等式约束。该架构将一个以预测精度为目标的任务网络,与一个使用随机和鲁棒优化文献中的决策规则训练的安全网络结合,最终输出为两者的凸组合,保证在整个输入空间中训练与推理时均满足约束,无需迭代过程或运行时优化。我们证明该结构是受限函数的通用逼近器,并推导出基于线性决策规则的可计算形式。基准回归任务的实验证明,该方法在持续满足约束的同时,保持了具有竞争力的准确率和低推理延迟。

原文摘要 · Abstract (English)

Deep learning models are increasingly deployed in safety-critical tasks where predictions must satisfy hard constraints, such as physical laws, fairness requirements, or safety limits. However, standard architectures lack built-in mechanisms to enforce such constraints, and existing approaches based on regularization or projection are often limited to simple constraints, computationally expensive, or lack feasibility guarantees. This paper proposes a model-agnostic framework for enforcing input-dependent linear equality and inequality constraints on neural network outputs. The architecture combines a task network trained for prediction accuracy with a safe network trained using decision rules from the stochastic and robust optimization literature to ensure feasibility across the entire input space. The final prediction is a convex combination of the two subnetworks, guaranteeing constraint satisfaction during both training and inference without iterative procedures or runtime optimization. We prove that the architecture is a universal approximator of constrained functions and derive computationally tractable formulations based on linear decision rules. Empirical results on benchmark regression tasks show that our method consistently satisfies constraints while maintaining competitive accuracy and low inference latency.

约束学习决策规则安全模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。