将外部知识转为三元组结构,提升大模型推理时的检索精度与效率。
Transforming External Knowledge into Triplets for Enhanced Retrieval in RAG of LLMs

- 把自然语言知识转化为条件-证明-结论三元组,增强逻辑关联性。
- 在多个数据集上显著提升检索质量,减少冗余信息和令牌消耗。
- 适合需要精准推理和高效资源利用的复杂任务场景。
检索增强生成(RAG)通过在生成过程中引入外部知识,缓解大语言模型的幻觉问题。然而,RAG的效果不仅取决于检索器设计和模型容量,还依赖于检索到的证据如何组织与查询对齐。现有方法通常直接检索并拼接非结构化文本片段作为上下文,常导致冗余或弱相关信息堆积,引发上下文过度膨胀、语义对齐度下降及推理链条断裂,进而降低生成质量并增加令牌开销。为此,本文提出Tri-RAG——一种基于三元组的结构化检索框架,通过轻量级提示适配与冻结参数方式,自动将外部知识从自然语言转化为包含条件、证明、结论的标准三元组,显式捕捉知识片段间的逻辑关系。在此基础上,以三元组的“条件”部分作为显式语义锚点进行检索与匹配,无需直接拼接长文本,实现精准的知识单元定位。实验结果表明,Tri-RAG在多个基准数据集上显著提升检索质量与推理效率,同时在复杂推理场景中表现出更稳定的生成行为和更高的资源利用效率。
原文摘要 · Abstract (English)
Retrieval-Augmented Generation (RAG) mitigates hallucination in large language models (LLMs) by incorporating external knowledge during generation. However, the effectiveness of RAG depends not only on the design of the retriever and the capacity of the underlying model, but also on how retrieved evidence is structured and aligned with the query. Existing RAG approaches typically retrieve and concatenate unstructured text fragments as context, which often introduces redundant or weakly relevant information. This practice leads to excessive context accumulation, reduced semantic alignment, and fragmented reasoning chains, thereby degrading generation quality while increasing token consumption. To address these challenges, we propose Tri-RAG, a structured triplet-based retrieval framework that improves retrieval efficiency through reasoning-aligned context construction. Tri-RAG automatically transforms external knowledge from natural language into standardized structured triplets consisting of Condition, Proof, and Conclusion, explicitly capturing logical relations among knowledge fragments using lightweight prompt-based adaptation with frozen model parameters. Building on this representation, the triplet head Condition is treated as an explicit semantic anchor for retrieval and matching, enabling precise identification of query-relevant knowledge units without directly concatenating lengthy raw texts. As a result, Tri-RAG achieves a favorable balance between retrieval accuracy and context token efficiency. Experimental results across multiple benchmark datasets demonstrate that Tri-RAG significantly improves retrieval quality and reasoning efficiency, while producing more stable generation behavior and more efficient resource utilization in complex reasoning scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。