提出新型逻辑框架QLL,让神经符号学习更可验证且高效。
Quantitative Linear Logic for Neuro-Symbolic Learning and Verification

- 用机器学习中常用的加法与log-sum-exp操作构建逻辑语义。
- 在对抗攻击测试中,模型表现与逻辑约束验证结果高度相关。
- 适合关注可解释性与形式化验证的神经符号学习研究者。
可微逻辑被用于神经符号学习任务中,以将逻辑约束嵌入神经网络的训练目标。可微逻辑包含语法(书写逻辑性质)和语义(将其解释为实值函数并融入损失函数)。该领域存在一个核心权衡:逻辑连结词的逻辑性质与语义的分析可行性。一端是具有成熟代数与证明论基础的模糊逻辑,另一端是为深度学习设计的非系统性可微逻辑(如Fischer的DL2),但尚未出现令人满意的理论基础。本文提出一种新逻辑——定量线性逻辑(Quantitative Linear Logic, QLL),旨在解决这一长期矛盾。设计原则基于自然性:由于逻辑约束被转化为损失,其连结词的语义应使用机器学习实践中常见的操作(如求和与log-sum-exp),作用于加性量(如logits)。我们从两个方面评估:逻辑充分性(是否满足线性逻辑的大部分标准逻辑律)与实证有效性(测试时性能,通过对抗攻击衡量,与离线神经网络验证器测量的实际逻辑约束验证结果高度相关),表明QLL在现有技术中表现突出。
原文摘要 · Abstract (English)
Differentiable Logics are deployed in neuro-symbolic learning tasks as a way of embedding logical constraints in the training objective of neural networks. A differentiable logic consists of a syntax to write logical properties and a semantics to interpret them as real-valued functions to be folded in the loss function. A defining trade-off of the field is that between logical properties of the connectives, and analytic concerns for the semantics, with both aspects being relevant in applications. At one extreme we find fuzzy logics, that have well-established algebraic and proof-theoretic foundations, and at the other ad-hoc differentiable logics like Fischer's DL2, conceived for deep learning applications. However, no satisfactory foundation has emerged yet. We propose a resolution to this long-standing tension via a novel logic, Quantitative Linear Logic (QLL), with foundational ambitions. Our design is driven by naturality -- the idea that, since logical constraints are translated to losses, the semantics of the connectives should be pertinent operations used in ML practice (that is, sum and log-sum-exp) on additive quantities (like logits). We then judge the result on two aspects: logical adequacy -- that they satisfy most of the standard logical laws of Linear Logic; and empirical effectiveness -- test-time performance (as measured by adversarial attacks) is well-correlated to the actual verification of the logical constraints (as measured by off-the-shelf neural network verifiers), which makes QLL stand out among SoTA techniques.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。