用多智能体框架解决长文档理解中的证据稀疏问题
Resolving Evidence Sparsity: Agentic Context Engineering for Long-Document Understanding
- 构建多智能体系统,分层筛选文本与图像关键线索
- 在多个长文档基准上达到当前最优性能,显著提升准确率
- 适合需要跨页跨模态分析的复杂文档理解任务
文档理解是一项长期存在的实际任务。视觉语言模型(VLMs)在单页任务中表现优异,但在处理长文档时效果下降。由于线索分散于多页和多模态中,且输入冗余影响判断,现有方法如检索增强生成仍存在大量冗余。为此,我们提出SLEUTH,一个由检索器和四个协作智能体组成的多智能体框架,采用粗到细的处理流程。该框架识别检索页面中的关键文本与视觉线索,过滤出表格、图表等显著视觉证据,并根据查询设计推理策略,最终合成凝练的多模态上下文以生成预测。SLEUTH具备模型无关性与可扩展性,搭配先进VLM骨干网络,在多个长文档基准上持续提升性能,达到当前最优结果。消融实验验证了各模块有效性,确认了层级精炼范式的优越性。
原文摘要 · Abstract (English)
Document understanding is a long standing practical task. Vision Language Models (VLMs) have gradually become a primary approach in this domain, demonstrating effective performance on single page tasks. However, their effectiveness diminishes when handling long documents. In such scenarios, clues are often scattered across multiple pages and modalities, and redundancy from lengthy inputs can impair the models judgment. While retrieval augmented generation mitigates this issue by filtering for question relevant content, the retrieved results still contain substantial redundancy. To address these limitations, we propose SLEUTH, a multi agent framework. Concretely, SLEUTH orchestrates a retriever and four collaborative agents in a coarse to fine process. The framework identifies key textual and visual clues within the retrieved pages, filters for salient visual evidence such as tables and charts, and analyzes the query to devise a reasoning strategy. It ultimately synthesizes a distilled, evidence dense multimodal context to generate the final prediction. SLEUTH is model agnostic and scalable. When paired with advanced VLM backbones, it consistently improves performance on multiple long document benchmarks, achieving state of the art results. Ablation studies verify each modules effectiveness and confirm the benefits of our hierarchical refinement paradigm.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。