用结构感知与多样性约束构建紧凑文档上下文,提升企业检索效果。
Structure and Diversity Aware Context Bubble Construction for Enterprise Retrieval Augmented Systems
- 基于文档结构和任务先验,动态组装多粒度段落块。
- 在有限令牌预算下,减少冗余并覆盖二级以上语义特征。
- 适合对上下文准确性要求高的企业级问答系统使用。
大语言模型的上下文通常通过检索增强生成(RAG)构建,即排序并选取前k个段落。该方法导致文档信息图碎片化、过度检索、内容重复,且查询上下文不足,缺乏二阶、三阶语义层面。本文提出一种结构感知、多样性约束的上下文气泡构造框架,可在严格令牌预算下整合连贯、可引用的文本片段集合。该方法利用文档固有结构,组织多粒度段落(如章节、表格行),并通过任务相关的结构先验引导检索。从高相关性锚点段落出发,通过受限选择构建上下文气泡,平衡查询相关性、边际覆盖与冗余惩罚。显式约束多样性和预算,生成紧凑且信息丰富的上下文集,优于传统top-k检索。此外,系统输出完整检索路径,支持可审计与确定性调优。在企业文档上的实验表明,上下文气泡显著降低冗余,更充分覆盖次要语义维度,且在有限上下文窗口内提升答案质量与引用忠实度。消融实验证明,结构先验与多样性约束均不可或缺;移除任一组件都会导致覆盖下降及冗余或不完整上下文增加。
原文摘要 · Abstract (English)
Large language model (LLM) contexts are typically constructed using retrieval-augmented generation (RAG), which involves ranking and selecting the top-k passages. The approach causes fragmentation in information graphs in document structures, over-retrieval, and duplication of content alongside insufficient query context, including 2nd and 3rd order facets. In this paper, a structure-informed and diversity-constrained context bubble construction framework is proposed that assembles coherent, citable bundles of spans under a strict token budget. The method preserves and exploits inherent document structure by organising multi-granular spans (e.g., sections and rows) and using task-conditioned structural priors to guide retrieval. Starting from high-relevance anchor spans, a context bubble is constructed through constrained selection that balances query relevance, marginal coverage, and redundancy penalties. It will explicitly constrain diversity and budget, producing compact and informative context sets, unlike top-k retrieval. Moreover, a full retrieval is emitted that traces the scoring and selection choices of the records, thus providing auditability and deterministic tuning. Experiments on enterprise documents demonstrate the efficiency of context bubble as it significantly reduces redundant context, is better able to cover secondary facets and has a better answer quality and citation faithfulness within a limited context window. Ablation studies demonstrate that both structural priors as well as diversity constraint selection are necessary; removing either component results in a decline in coverage and an increase in redundant or incomplete context.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。