arXiv:2603.11650cs.CL2026-03被引 2

用多智能体辩论机制生成更连贯、信息更丰富的文本块,提升领域RAG效果

QChunker: Learning Question-Aware Text Chunking for Domain RAG via Multi-Agent Debate

  • 设计多智能体框架,以问题引导文本分块与知识补全
  • 构建4.5万条高质量数据集,显著提升小模型分块能力
  • 提出新评估指标ChunkScore,高效判断文本块质量

检索增强生成(RAG)的效果上限受制于知识库中文本块的语义完整性和信息粒度。本文提出QChunker,将RAG范式重构为理解-检索-增强流程。首先将文本分块建模为文本分割与知识补全的复合任务,确保文本块逻辑连贯。受哈尔·格雷森“问题即答案”理论启发,设计包含问题概要生成器、文本分段器、完整性评审者和知识补全者四个组件的多智能体辩论框架,以问题激发深层洞察。通过该流程,成功构建4.5万条高质量数据集,并将其能力迁移至小语言模型。针对现有分块评估方法依赖下游问答任务导致长评价链与低效率的问题,提出新型直接评估指标ChunkScore,理论与实验均验证其可高效精准区分文本块质量。在文本分段阶段,利用文档大纲进行多路径采样生成候选块,采用ChunkScore选择最优解。跨四个异构领域的大量实验表明,QChunker通过提供更逻辑连贯、信息更丰富的文本块,有效解决前述问题。

原文摘要 · Abstract (English)

The effectiveness upper bound of retrieval-augmented generation (RAG) is fundamentally constrained by the semantic integrity and information granularity of text chunks in its knowledge base. To address these challenges, this paper proposes QChunker, which restructures the RAG paradigm from retrieval-augmentation to understanding-retrieval-augmentation. Firstly, QChunker models the text chunking as a composite task of text segmentation and knowledge completion to ensure the logical coherence and integrity of text chunks. Drawing inspiration from Hal Gregersen's "Questions Are the Answer" theory, we design a multi-agent debate framework comprising four specialized components: a question outline generator, text segmenter, integrity reviewer, and knowledge completer. This framework operates on the principle that questions serve as catalysts for profound insights. Through this pipeline, we successfully construct a high-quality dataset of 45K entries and transfer this capability to small language models. Additionally, to handle long evaluation chains and low efficiency in existing chunking evaluation methods, which overly rely on downstream QA tasks, we introduce a novel direct evaluation metric, ChunkScore. Both theoretical and experimental validations demonstrate that ChunkScore can directly and efficiently discriminate the quality of text chunks. Furthermore, during the text segmentation phase, we utilize document outlines for multi-path sampling to generate multiple candidate chunks and select the optimal solution employing ChunkScore. Extensive experimental results across four heterogeneous domains exhibit that QChunker effectively resolves aforementioned issues by providing RAG with more logically coherent and information-rich text chunks.

RAG文本分块多智能体评估指标

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。