arXiv:2608.29037cs.CVcs.AI2026-08

让修复图像更懂任务需求,自动选工具提升文档问答准确率

DocIntent: Answerability-Guided Agentic Restoration for Real-World Document Visual Question Answering

论文配图:DocIntent: Answerability-Guided Agentic Restoration for Real-World Document Visual Question Answering
图 1 · 摘自论文原文
  • 先判断问题能否回答,再针对性选择修复工具
  • 修复后若关键信息变模糊就自动撤销,保证答案可读性
  • 无需额外训练或模型,适配各类主流文档问答系统

真实世界文档常存在模糊、阴影、畸变和摩尔纹等退化现象,严重降低多模态大模型的文档问答能力。在视觉问答前使用修复工具是直观方案,但现有方法依赖人工设计修复策略,耗时且需领域知识。代理式修复虽有自动化潜力,但多数框架针对自然图像优化感知质量,忽视修复应服务于下游任务。为此,本文提出DocIntent——一种无需训练的答案可回答性引导代理修复框架。该框架首先评估问题是否可答,再识别与任务相关退化并选择性调用修复工具;通过基于对比的回滚机制验证每步修复效果,若关键证据变得难以辨识则自动撤销。整个流程无需预训练退化分类器或图像质量评估模型。在WildDoc基准上的大量实验表明,DocIntent持续提升了不同开源与闭源多模态大模型的平均得分与结果一致性。代码与数据将公开。

原文摘要 · Abstract (English)

Real-world degradations such as blur, shadow, distortion, and moire patterns severely impair the document question-answering capabilities of Multimodal Large Language Models (MLLMs). Applying restoration tools before Visual Question Answering (VQA) is an intuitive solution. However, existing restoration approaches remain limited, as manually designing and executing restoration strategies is labor-intensive and requires domain expertise. Agentic restoration offers new possibilities for automation, yet existing frameworks primarily target natural images and pursue perceptual quality, overlooking that restoration should serve downstream tasks rather than optimize generic image quality metrics. To this end, we explore the value of agentic restoration for real-world degraded document VQA and propose DocIntent, a training-free Answerability-Guided Agentic Restoration framework. DocIntent first assesses question answerability, then identifies task-relevant degradations and selectively invokes restoration tools. A Comparison-Based Rollback mechanism validates each restoration step and reverts it when question-relevant evidence becomes less decipherable. The entire process requires no additional pretrained degradation classifier or image quality assessment model. Extensive experiments on the WildDoc benchmark show that DocIntent consistently improves the average score and consistency of different open- and closed-source MLLMs. The code and experimental data will be publicly available.

文档问答图像修复智能代理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。