arXiv:2503.12917cs.AI2025-03ICML被引 3

无需标签也能训练神经符号系统,让无监督推理更高效可靠。

Verification Learning: Make Unsupervised Neuro-Symbolic System Feasible

  • 用规则验证代替标签,将推理转为无监督的可验证过程。
  • 在加法、排序等任务上达到高精度,计算成本降低显著。
  • 适合追求低依赖标注、高鲁棒性的符号推理研究者。

当前神经符号学习严重依赖标注数据,完全抛弃标签会导致符号信息不足、解空间过大及捷径问题,现有系统无法解决。本文提出验证学习(Verification Learning, VL)新范式,将基于标签的推理转换为无标签的规则验证过程。仅依靠无标签数据和规则一致性验证函数,即可实现优异学习效果。我们将该问题形式化为约束优化问题(COP),并提出动态组合排序(DCS)算法,通过减少验证次数加速求解,有效降低计算开销;同时引入先验对齐方法缓解潜在捷径。理论分析揭示了哪些任务可在无标签下完成,并解释为何某些任务中规则可替代无限标签,而另一些则无效。在加法、排序、匹配和国际象棋等全无监督任务中验证框架,均展现显著性能与效率提升。

原文摘要 · Abstract (English)

The current Neuro-Symbolic (NeSy) Learning paradigm suffers from an over-reliance on labeled data, so if we completely disregard labels, it leads to less symbol information, a larger solution space, and more shortcuts-issues that current Nesy systems cannot resolve. This paper introduces a novel learning paradigm, Verification Learning (VL), which addresses this challenge by transforming the label-based reasoning process in Nesy into a label-free verification process. VL achieves excellent learning results solely by relying on unlabeled data and a function that verifies whether the current predictions conform to the rules. We formalize this problem as a Constraint Optimization Problem (COP) and propose a Dynamic Combinatorial Sorting (DCS) algorithm that accelerates the solution by reducing verification attempts, effectively lowering computational costs and introduce a prior alignment method to address potential shortcuts. Our theoretical analysis points out which tasks in Nesy systems can be completed without labels and explains why rules can replace infinite labels for some tasks, while for others the rules have no effect. We validate the proposed framework through several fully unsupervised tasks including addition, sort, match, and chess, each showing significant performance and efficiency improvements.

神经符号无监督学习规则验证推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。