提升RAG生成结果可信度,从索引到生成全程优化
TrustRAG: An Information Assistant with Retrieval Augmented Generation
- 分层切块+上下文补充,保证知识片段语义完整
- 按信息价值筛选,减少冗余输入并提升质量
- 句级引用推断,精准定位观点来源,增强可信度
RAG已成为增强大模型实时与领域知识的关键技术。尽管已有诸多改进和开源工具提升RAG的准确性,但对其生成结果可信度的关注仍不足。为此,我们提出TrustRAG框架,从索引、检索、生成三方面增强RAG的可信性:在索引阶段,采用融合层次结构的语义增强切块策略,为每个片段补充上下文信息,保障语义完整性;在检索阶段,引入基于效用的过滤机制,识别高质量信息,支持答案生成同时降低输入长度;在生成阶段,提出细粒度引用增强方法,检测回答中带观点的句子,并在句级推断引用关系,提升引用准确性。我们开源了TrustRAG框架,并提供面向片段问答任务的演示平台(https://huggingface.co/spaces/golaxy/TrustRAG)。旨在帮助研究者系统性提升RAG系统的可信度,并开发输出更可靠的RAG应用。
原文摘要 · Abstract (English)
\Ac{RAG} has emerged as a crucial technique for enhancing large models with real-time and domain-specific knowledge. While numerous improvements and open-source tools have been proposed to refine the \ac{RAG} framework for accuracy, relatively little attention has been given to improving the trustworthiness of generated results. To address this gap, we introduce TrustRAG, a novel framework that enhances \ac{RAG} from three perspectives: indexing, retrieval, and generation. Specifically, in the indexing stage, we propose a semantic-enhanced chunking strategy that incorporates hierarchical indexing to supplement each chunk with contextual information, ensuring semantic completeness. In the retrieval stage, we introduce a utility-based filtering mechanism to identify high-quality information, supporting answer generation while reducing input length. In the generation stage, we propose fine-grained citation enhancement, which detects opinion-bearing sentences in responses and infers citation relationships at the sentence-level, thereby improving citation accuracy. We open-source the TrustRAG framework and provide a demonstration studio designed for excerpt-based question answering tasks \footnote{https://huggingface.co/spaces/golaxy/TrustRAG}. Based on these, we aim to help researchers: 1) systematically enhancing the trustworthiness of \ac{RAG} systems and (2) developing their own \ac{RAG} systems with more reliable outputs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。