用同伦类型论改进神经符号推理,让模型更懂对称性带来的逻辑捷径。
A homotopy-type-theoretic generalization of neurosymbolic inference
- 引入同伦基数思想,用对称性重定义信念加权的计算方式。
- 在MNIST推理基准上,单模型方法比集成方法更校准,且不损失准确率。
- 适合研究神经符号系统、形式推理与可解释性的学者参考。
大量神经符号(NeSy)系统计算一个函数:在σ-结构空间上对逻辑量进行带权重求和,加权模型计数、模糊逻辑和概率逻辑均为特例。该框架基于集合,但集合会忽略两个关键信息:理论对称性下两个σ-结构是否等价,以及有多少不同证明能支持某个查询。同伦类型论中的“类型”保留这些信息,将原函数推广为信念加权同伦基数——一种按对称性反比计数对象大小的新概念。本文从零构建该框架,证明其在无对称性时退化为经典函数,并揭示该框架暴露的对称性正是推理捷径的来源。实际收益显著:近期通过集成或高表达密度估计实现的捷径感知概念后验,实为混淆集单纯形中唯一对称不变点,可通过单模型在对称群上平均闭式求解。在MNIST推理捷径基准上,该单模型封装方法校准性能优于多样性训练的集成,同时保持标签准确率和可识别概念不变。代码开源:https://github.com/bio-ontology-research-group/hott-nesy。
原文摘要 · Abstract (English)
A wide range of neurosymbolic (NeSy) systems compute one functional: a belief-weighted sum of a logical quantity over a space of $σ$-structures, of which weighted model counting, fuzzy logic, and probabilistic logic are special cases. This account is built on sets, and a set deliberately forgets two things that are important for NeSy: when two $σ$-structures are the same up to a symmetry of the theory, and how many distinct proofs witness a query. Types, in the sense of homotopy type theory, preserve this information and turn the functional into a belief-weighted homotopy cardinality, a notion of size that counts each object in inverse proportion to its symmetries. We develop the framework from scratch for NeSy systems, prove a conservativity theorem that recovers the classical functional when symmetries are trivial, and show that the symmetry our framework exposes is exactly the one behind reasoning shortcuts. The payoff is concrete: the shortcut-aware concept posterior that recent methods reach by ensembling or expressive density estimation is the only symmetry-invariant point of the confusion-set simplex, computable in closed form by averaging a single model over the symmetry group. On MNIST reasoning-shortcut benchmarks this single-model wrapper is better calibrated than a diversity-trained ensemble, while leaving label accuracy and identifiable concepts untouched. Code is freely available at https://github.com/bio-ontology-research-group/hott-nesy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。