arXiv:2505.10870cs.CLcs.AI2025-05ACL被引 5

用大模型生成推理规则,提升知识检索准确率

Improve Rule Retrieval and Reasoning with Self-Induction and Relevance ReEstimate

  • 用大模型从查询中抽象出潜在推理规则,用于增强查询
  • 重新评估检索规则的相关性,使其更符合查询事实
  • 适用于需要精准逻辑推理的问答与知识系统

本文系统解决规则检索这一关键但研究不足的问题。传统检索方法使用稀疏或稠密检索器直接查找支持下游推理的相关规则,常因查询中的具体事实与规则的抽象表示之间存在显著语义鸿沟,导致检索准确率低,进而影响推理性能。为此,我们提出自诱导增强检索(SIAR),利用大语言模型(LLMs)从查询中抽象底层知识和逻辑结构,生成潜在的推断规则,用于查询增强以提升检索效果。此外,提出规则相关性重估(R$^3$),通过判断规则所含抽象知识是否可实例化为查询中的事实,并评估其对推理的帮助程度,来重估检索规则的相关性。在多种设置下的大量实验表明,所提方法具有有效性与通用性。

原文摘要 · Abstract (English)

This paper systematically addresses the challenges of rule retrieval, a crucial yet underexplored area. Vanilla retrieval methods using sparse or dense retrievers to directly search for relevant rules to support downstream reasoning, often suffer from low accuracy. This is primarily due to a significant semantic gap between the instantiated facts in the queries and the abstract representations of the rules. Such misalignment results in suboptimal retrieval quality, which in turn negatively impacts reasoning performance. To overcome these challenges, we propose Self-Induction Augmented Retrieval (SIAR), a novel approach that utilizes Large Language Models (LLMs) to induce potential inferential rules that might offer benefits for reasoning by abstracting the underlying knowledge and logical structure in queries. These induced rules are then used for query augmentation to improve retrieval effectiveness. Additionally, we introduce Rule Relevance ReEstimate (R$^3$), a method that re-estimates the relevance of retrieved rules by assessing whether the abstract knowledge they contain can be instantiated to align with the facts in the queries and the helpfulness for reasoning. Extensive experiments across various settings demonstrate the effectiveness and versatility of our proposed methods.

规则检索大模型推理增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。