arXiv:2412.02563cs.CLcs.AI2024-12

通过评估模块提升检索生成系统的准确性与可靠性。

Semantic Tokens in Retrieval Augmented Generation

  • 引入评估模块对比外部推荐与文档片段,增强决策能力。
  • 在小数据集上显著提升简单问题的解答准确率。
  • 适合需要高精度与可验证性的问答场景使用。

检索增强生成(RAG)架构因其在自然语言处理任务中提升事实准确性和连贯性而受到广泛关注。然而,随着系统访问数据量的增加,其生成答案的可靠性下降;即使在小数据集上,也时常无法回答简单问题。这源于对先进大语言模型的依赖,导致输出存在不确定性。本文提出一种新型对比RAG系统,引入评估模块,将概率性RAG系统与确定性可验证响应之间的差距弥合。该评估模块比较外部推荐与检索到的文档片段,增加决策层,确保检索内容在语义相关性与逻辑一致性上均达标,从而提升RAG系统的准确性和整体效率。该框架为高精度与可验证性要求高的问答应用提供了更可靠、可扩展的解决方案。

原文摘要 · Abstract (English)

Retrieval-Augmented Generation (RAG) architectures have recently garnered significant attention for their ability to improve truth grounding and coherence in natural language processing tasks. However, the reliability of RAG systems in producing accurate answers diminishes as the volume of data they access increases. Even with smaller datasets, these systems occasionally fail to address simple queries. This issue arises from their dependence on state-of-the-art large language models (LLMs), which can introduce uncertainty into the system's outputs. In this work, I propose a novel Comparative RAG system that introduces an evaluator module to bridge the gap between probabilistic RAG systems and deterministically verifiable responses. The evaluator compares external recommendations with the retrieved document chunks, adding a decision-making layer that enhances the system's reliability. This approach ensures that the chunks retrieved are both semantically relevant and logically consistent with deterministic insights, thereby improving the accuracy and overall efficiency of RAG systems. This framework paves the way for more reliable and scalable question-answering applications in domains requiring high precision and verifiability.

检索生成大模型可靠性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。