arXiv:2605.30456cs.LGmath.OC2026-05

让神经网络精确满足复杂规则,提升科学工程中的小样本学习效果。

DisjunctiveNet: Neural Symbolic Learning via Differentiable Convexified Optimization Layers

  • 将逻辑规则转为可微分的凸松弛约束,实现端到端硬约束满足。
  • 在真实数据集上达到100%规则满足率,同时保持强预测性能。
  • 适合需要严格遵守物理规律或业务规则的科研与工业场景。

科学与工程中的许多学习任务面临数据稀疏问题,纯数据驱动方法效果有限。同时,这些问题常伴随丰富的领域知识,如物理定律、运行要求和专家经验,通常以逻辑命题和线性不等式形式表达。现有神经符号方法多通过软惩罚近似规则,假设输入无关的规则,或依赖非可微后处理实现硬约束。尽管可微优化层已支持神经网络内端到端可行性约束,但扩展至逻辑或混合整数规则仍因固有的非凸性而困难。本文提出一种统一的端到端框架,可在神经网络中强制执行输入相关的混合整数线性约束。方法将规则表示为析取约束,并采用分层凸松弛获得凸包形式,生成可嵌入的可微优化层,实现精确规则满足。在真实数据集上的实验表明,该框架实现了100%规则满足率,并保持优异的预测性能。

原文摘要 · Abstract (English)

Many learning tasks in science and engineering are characterized by sparse datasets, which limits the effectiveness of purely data-driven approaches. At the same time, these problems are often accompanied by rich domain knowledge derived from physical laws, operational requirements, and expert heuristics. Such knowledge is frequently expressed as rules involving logical propositions and linear inequalities. Existing neuro-symbolic methods typically enforce these rules approximately through soft penalties, assume input-independent rules when designing specialized architectures, or rely on non-differentiable post-processing at inference time to achieve hard constraint satisfaction. While recent advances in differentiable optimization layers enable end-to-end feasibility enforcement within neural networks, extending these approaches to logical or mixed-integer rules remains challenging due to inherent nonconvexity. In this work, we propose a unified end-to-end framework for enforcing hard, input-dependent mixed integer linear constraints within neural networks. Our approach represents rules as disjunctive constraints and applies hierarchical convex relaxations to obtain convex hull formulations. These relaxations yield tractable linear constraints that can be embedded as differentiable optimization layers while enabling exact rule satisfaction. We demonstrate the effectiveness of the proposed framework on real-world datasets, achieving perfect rule satisfaction and strong predictive performance.

神经符号可微优化约束学习混合整数

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。