MeVe通过分阶段验证与控制,让大模型只用有效信息,提升问答准确率。
MeVe: A Modular System for Memory Verification and Effective Context Control in Language Models
- 分五阶段处理检索与上下文构建,每步可独立调整
- 在维基百科上减少57%冗余信息,HotpotQA上减少75%
- 适合需要高准确性和可控性的知识密集型应用
检索增强生成(RAG)系统常因简单顶-k语义搜索导致引入无关或重复信息,降低性能与效率。本文提出MeVe,一种模块化架构,用于记忆验证与智能上下文组合。该架构采用五阶段设计:初始检索、相关性验证、备用检索、上下文优先级排序和令牌预算管理,将检索与上下文构建过程解耦,实现可审计、可调优的细粒度控制。我们发布了参考实现,并在英文维基百科子集[22]上评估其在知识密集型问答任务上的表现。结果表明,通过在组合前主动验证信息,MeVe显著提升上下文效率:在维基百科数据集上减少57%,在更复杂的HotpotQA数据集上减少75%,优于标准RAG实现[25]。该工作为更可扩展、可靠的大型语言模型应用提供了框架,通过精炼上下文信息,推动更好的事实对齐与准确性支持[16]。
原文摘要 · Abstract (English)
Retrieval-Augmented Generation (RAG) systems typically face constraints because of their inherent mechanism: a simple top-k semantic search [1]. The approach often leads to the incorporation of irrelevant or redundant information in the context, degrading performance and efficiency [10][11]. This paper presents MeVe, a novel modular architecture intended for Memory Verification and smart context composition. MeVe rethinks the RAG paradigm by proposing a five-phase modular design that distinctly breaks down the retrieval and context composition process into distinct, auditable, and independently tunable phases: initial retrieval, relevance verification, fallback retrieval, context prioritization, and token budgeting. This architecture enables fine-grained control of what knowledge is made available to an LLM, enabling task-dependent filtering and adaptation. We release a reference implementation of MeVe as a proof of concept and evaluate its performance on knowledge-heavy QA tasks over a subset of English Wikipedia [22]. Our results demonstrate that by actively verifying information before composition, MeVe significantly improves context efficiency, achieving a 57% reduction on the Wikipedia dataset and a 75% reduction on the more complex HotpotQA dataset compared to standard RAG implementations [25]. This work provides a framework for more scalable and reliable LLM applications. By refining and distilling contextual information, MeVe offers a path toward better grounding and more accurate factual support [16].
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。