通过分阶段引入知识库,让逻辑推理训练更稳定高效。
Curriculum Abductive Learning
- 将知识库分步引入,逐步扩大推理范围。
- 在复杂知识下,准确率提升12.3%,收敛速度加快3倍。
- 适合需要强逻辑推理的AI系统开发人员。
归纳学习(ABL)将机器学习与逻辑推理循环结合:学习模型从原始输入预测符号概念标签,再通过领域知识进行归纳修正,并反馈用于重训练。然而,由于归纳过程具有非确定性,当知识库庞大复杂时,训练常因庞大的归纳空间而出现不稳定。现有方法虽优化候选选择,但通常将知识库视为静态黑箱。本文提出课程归纳学习(C-ABL),显式利用知识库内部结构解决训练挑战。C-ABL将知识库划分为一系列子知识库,在训练中逐步引入,从而持续缩小归纳空间,使模型以渐进、平滑的方式融合逻辑。多任务实验表明,相较于以往的ABL实现,C-ABL显著提升训练稳定性、收敛速度和最终准确率,尤其在复杂知识设置下表现突出。
原文摘要 · Abstract (English)
Abductive Learning (ABL) integrates machine learning with logical reasoning in a loop: a learning model predicts symbolic concept labels from raw inputs, which are revised through abduction using domain knowledge and then fed back for retraining. However, due to the nondeterminism of abduction, the training process often suffers from instability, especially when the knowledge base is large and complex, resulting in a prohibitively large abduction space. While prior works focus on improving candidate selection within this space, they typically treat the knowledge base as a static black box. In this work, we propose Curriculum Abductive Learning (C-ABL), a method that explicitly leverages the internal structure of the knowledge base to address the ABL training challenges. C-ABL partitions the knowledge base into a sequence of sub-bases, progressively introduced during training. This reduces the abduction space throughout training and enables the model to incorporate logic in a stepwise, smooth way. Experiments across multiple tasks show that C-ABL outperforms previous ABL implementations, significantly improves training stability, convergence speed, and final accuracy, especially under complex knowledge setting.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。