arXiv:2606.04231cs.CLcs.AI2026-06ACL被引 1

针对企业文档问答,提出结构感知的多模态检索增强生成方法

MM-BizRAG: Rethinking Multimodal Retrieval-Augmented Generation for General Purpose Enterprise Q&A

论文配图:MM-BizRAG: Rethinking Multimodal Retrieval-Augmented Generation for General Purpose Enterprise Q&A
图 1 · 摘自论文原文
  • 按文档结构动态分流,分层处理垂直报告与水平幻灯片
  • 无需微调,在企业数据集上性能领先基线32个百分点
  • 适合需要高精度文档理解的企业级问答系统

当前多模态检索增强生成(MM-RAG)趋向于简化解析,依赖页面级图像生成嵌入和答案。然而这种方法常忽略复杂企业文档中丰富的结构化信息,仅依赖预训练模型隐式捕捉。本文提出MM-BizRAG,通过文档结构感知的分块策略,动态将文档路由至定向处理流程:对垂直结构文档(如报告)采用显式布局解析,对水平结构文档(如幻灯片)使用整体页面表示。统一的基于大模型的构件转换管道结合占位符定位对齐,保持自然阅读顺序;推理时多模态组装解耦检索表示与生成上下文,实现更精准、有依据的回答,且无需微调。在大型异构企业数据集及两个公开基准(SlideVQA、FinRAGBench-V)上的实验表明,该方法相比最先进视觉主导基线最高提升32个百分点,尤其在报告类布局上表现突出。此外,提出FastRAGEval——单次调用的大模型评估指标,生成召回精度更高且成本仅为RAGChecker的一半。

原文摘要 · Abstract (English)

Recent advances in multimodal retrieval-augmented generation (MM-RAG) have shifted toward minimal parsing, relying on page-level images for producing retriever embeddings and for answer generation. While efficient, this trend often neglects explicit handling of the rich, structured information in complex enterprise documents, instead depending on pre-trained embeddings or vision-language models to implicitly capture such structure. In this work, we take a more direct approach: MM-BizRAG proactively extracts and represents document structure via a document structure-aware split that dynamically routes documents through orientation-specific ingestion pipelines, applying explicit layout-aware parsing for vertically structured documents (e.g., reports) and holistic page-level representations for horizontally structured documents (e.g., slide decks). A unified LLM-driven artifact transformation pipeline with placeholder-based positional alignment preserves natural reading order, while inference-time multimodal assembly decouples retrieval representations from generation context, enabling richer, more grounded answers without any finetuning requirement. Through experiments on a large, heterogeneous enterprise dataset and two public benchmarks (SlideVQA and FinRAGBench-V), MM-BizRAG consistently outperforms state-of-the-art vision-centric baselines by up to 32% points, with especially strong gains on report-style layouts. Furthermore, we introduce FastRAGEval, a single-call LLM Judge metric for fine-grained generative recall that halves RAGChecker's cost while achieving stronger human alignment.

多模态企业问答RAG文档理解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。