arXiv:2603.05551cs.IRcs.CV2026-03

让图文问答更智能:根据问题难易自动选择检索与推理路径。

AutothinkRAG: Complexity-Aware Control of Retrieval-Augmented Reasoning for Image-Text Interaction

  • 通过查询复杂度路由动态选择检索或直接推理路径
  • 在长文档上达82.13%准确率,令牌消耗减少18.9%
  • 适合处理复杂、多步推理的图文问答任务

多模态文档问答需从视觉丰富的长文档中提取分散证据,并对异构信息进行可靠推理。现有多模态RAG系统受限于两个瓶颈:静态检索忽略查询复杂度,以及将视觉感知与逻辑推理耦合的端到端视觉语言模型(VLM),导致计算效率低且答案生成不稳定。我们提出AutoThinkRAG,一种面向多模态文档问答的复杂度感知推理架构。其包含两个组件:(1) 查询复杂度路由器,分析查询难度与结构,自适应选择检索与推理路径;(2) 感知-推理解耦架构,使用轻量级VLM作为高保真视觉解释器,将相关视觉线索转为文本表示,再交由大语言模型(LLM)进行逻辑推理与答案生成。该设计提升了效率与鲁棒性,尤其在长文档和无法回答的查询上表现突出。在DocBench和MMLongBench上的实验表明,AutoThinkRAG分别达到82.13%和51.29%的整体准确率,同时每查询令牌消耗减少18.9%,成本降低18.2%。进一步分析显示,收益在需要自适应检索与多步推理的复杂查询上最为显著。

原文摘要 · Abstract (English)

Multimodal document question answering requires retrieving dispersed evidence from visually rich long documents and performing reliable reasoning over heterogeneous information. Existing multimodal RAG systems remain limited by two bottlenecks: static retrieval that ignores query complexity, and end-to-end Vision-Language Models (VLMs) that couple visual perception with logical reasoning, leading to inefficient computation and unstable answer generation. We propose AutoThinkRAG, a complexity-aware inference architecture for multimodal document QA. It has two components: (1) a Query Complexity Router that analyzes query difficulty and structure to adaptively select retrieval and reasoning paths; and (2) a Perception--Reasoning Decoupling architecture that uses a lightweight VLM as a high-fidelity visual interpreter to convert query-relevant visual cues into textual representations, which are then passed to an LLM for logical reasoning and answer synthesis. This design improves both efficiency and robustness, especially on long-document and unanswerable queries. Experiments on DocBench and MMLongBench show that AutoThinkRAG achieves 82.13\% and 51.29\% overall accuracy, respectively, while reducing per-query token consumption by 18.9\% and monetary cost by 18.2\%. Further analyses show that the gains are most pronounced on complex queries requiring adaptive retrieval and multi-step reasoning.

图文问答RAG推理优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。