arXiv:2602.22225cs.IRcs.AI2026-02被引 1

智能分块检索:根据问题动态调整文档切片粒度,提升长文本问答准确率与效率。

SmartChunk Retrieval: Query-Aware Chunk Compression with Planning for Efficient Document RAG

  • 基于查询预测最优分块抽象层级,实现动态粒度检索。
  • 采用轻量压缩模块生成高层嵌入,避免重复摘要且降低计算开销。
  • 适用于多类型文档和多样化查询场景,适合实际应用部署。

检索增强生成(RAG)通过结合语言模型与大规模文本库中的证据,具备生成高精度、事实性输出的潜力。然而现有流程受限于静态分块与扁平化检索:文档被预设为固定长度的短片段,嵌入向量均匀检索,生成依赖返回的任意片段。该设计导致检索质量对分块大小敏感,易引入无关或误导性内容,且在大规模语料上扩展性差。本文提出SmartChunk检索框架,一种面向高效稳健长文档问答的查询自适应方法。其核心包含:(i) 规划器预测每条查询的最佳分块抽象层级;(ii) 轻量压缩模块生成高层级分块嵌入,无需重复摘要。通过实时调节检索粒度,平衡了准确率与效率,规避了固定策略的缺陷。特别地,规划器采用新颖的强化学习方案STITCH,显著提升准确率与泛化能力。为反映真实应用场景中多样的文档类型与查询风格,我们在五个QA基准及一个跨域数据集上评估SmartChunk。结果表明,其优于当前最先进RAG基线,同时降低成本。进一步分析显示,其在更大语料上具强可扩展性,且在跨域数据集上保持稳定增益,证明其作为通用自适应检索框架的有效性。

原文摘要 · Abstract (English)

Retrieval-augmented generation (RAG) has strong potential for producing accurate and factual outputs by combining language models (LMs) with evidence retrieved from large text corpora. However, current pipelines are limited by static chunking and flat retrieval: documents are split into short, predetermined, fixed-size chunks, embeddings are retrieved uniformly, and generation relies on whatever chunks are returned. This design brings challenges, as retrieval quality is highly sensitive to chunk size, often introduces noise from irrelevant or misleading chunks, and scales poorly to large corpora. We present SmartChunk retrieval, a query-adaptive framework for efficient and robust long-document question answering (QA). SmartChunk uses (i) a planner that predicts the optimal chunk abstraction level for each query, and (ii) a lightweight compression module that produces high-level chunk embeddings without repeated summarization. By adapting retrieval granularity on the fly, SmartChunk balances accuracy with efficiency and avoids the drawbacks of fixed strategies. Notably, our planner can reason about chunk abstractions through a novel reinforcement learning scheme, STITCH, which boosts accuracy and generalization. To reflect real-world applications, where users face diverse document types and query styles, we evaluate SmartChunk on five QA benchmarks plus one out-of-domain dataset. Across these evaluations, SmartChunk outperforms state-of-the-art RAG baselines, while reducing cost. Further analysis demonstrates strong scalability with larger corpora and consistent gains on out-of-domain datasets, highlighting its effectiveness as a general framework for adaptive retrieval.

RAG智能检索长文档问答动态分块

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。