arXiv:2603.06976cs.CLcs.AI2026-03被引 5

系统评估文档切分策略,发现智能分段能显著提升检索效果。

A Systematic Investigation of Document Chunking Strategies and Embedding Sensitivity

  • 对比36种分段方法,按语义和结构切分优于固定长度切分。
  • 最优策略使检索准确率提升至nDCG@5=0.459,首条命中率24%。
  • 揭示领域差异:生物物理用动态分块,法律数学用段落组合更优。

我们首次在跨领域大规模评估密集检索中的文档切分策略,涵盖六种知识领域及五种嵌入模型。36种分段方法(固定长度、语义、结构感知、层次化、自适应、LLM辅助)被评测,采用SOTA LLM评估器的分级相关性得分,以nDCG@5为主指标(辅以Hit@5、MRR)。结果表明,内容感知分段显著优于简单固定长度切分。最优策略Paragraph Group Chunking实现均值nDCG@5~0.459,Precision@1~24%,Hit@5~59%;而基线固定字符切分表现差(nDCG@5 < 0.244,Precision@1~2-3%)。领域差异明显:动态分块在生物、物理、健康领域最优,段落组合在法律与数学中最佳。大模型嵌入虽提升绝对分数,但仍受分段质量影响,说明优质分段与大模型具互补性。同时量化了高级分块的效率代价:更小更多片段会增加索引大小与延迟。最终识别出如动态分块等兼顾有效性和效率的平衡方案。研究确立分段是提升检索性能与可靠性的关键杠杆。

原文摘要 · Abstract (English)

We present the first large-scale, cross-domain evaluation of document chunking strategies for dense retrieval, addressing a critical but underexplored aspect of retrieval-augmented systems. In our study, 36 segmentation methods spanning fixed-size, semantic, structure-aware, hierarchical, adaptive, and LLM-assisted approaches are benchmarked across six diverse knowledge domains using five different embedding models. Retrieval performance is assessed using graded relevance scores from a state-of-the-art LLM evaluator, with Normalised DCG@5 as the primary metric (complemented by Hit@5 and MRR). Our experiments show that content-aware chunking significantly improves retrieval effectiveness over naive fixed-length splitting. The top-performing strategy, Paragraph Group Chunking, achieved the highest overall accuracy (mean nDCG@5~0.459) and substantially better top-rank hit rates (Precision@1~24%, Hit@5~59%). In contrast, simple fixed-size character chunking as baselines performed poorly (nDCG@5 < 0.244, Precision@1~2-3%). We observe pronounced domain-specific differences: dynamic token sizing is strongest in biology, physics and health, while paragraph grouping is strongest in legal and maths. Larger embedding models yield higher absolute scores but remain sensitive to suboptimal segmentation, indicating that better chunking and large embeddings provide complementary benefits. In addition to accuracy gains, we quantify the efficiency trade-offs of advanced chunking. Producing more, smaller chunks can increase index size and latency. Consequently, we identify methods (like dynamic chunking) that approach an optimal balance of effectiveness and efficiency. These findings establish chunking as a vital lever for improving retrieval performance and reliability.

文档检索分块策略嵌入模型RAG

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。