arXiv:2604.00161cs.CV2026-04

提出Q-Mask框架,让模型更准地定位图像中的文字位置。

Q-Mask: Query-driven Causal Masks for Text Anchoring in OCR-Oriented Vision-Language Models

论文配图:Q-Mask: Query-driven Causal Masks for Text Anchoring in OCR-Oriented Vision-Language Models
图 1 · 摘自论文原文
  • 用因果查询驱动的掩码解码器,逐步生成与查询相关的视觉掩码。
  • 在文本定位任务上超越现有模型,准确率提升显著。
  • 适合需要精准文字定位的OCR应用,如文档分析、视觉问答。

光学字符识别(OCR)正成为现代视觉语言模型的基础能力,不仅支持读取图像中的文字,还能在真实场景的视觉问答中进行推理。但实际应用还需可靠的文本锚点,即准确将查询的文字映射到其空间位置。为此,我们提出了TextAnchor-Bench(TABench)基准,用于细粒度的文本-区域定位评估,发现通用和专用OCR的视觉语言模型仍难以建立准确稳定的文本锚点。为解决此问题,我们提出Q-Mask,一种基于因果查询驱动掩码解码器(CQMD)的高精度OCR框架。受思维链推理启发,Q-Mask采用因果视觉解码,先生成与查询相关的视觉掩码,再输出最终识别结果。该视觉思维链范式将文本位置与内容分离,强制在识别前获取可解释的空间证据,实现推理过程中的显式文本锚构建。为训练CQMD,我们构建了TextAnchor-26M数据集,包含2600万张图像-文本对,标注了特定文本元素的细粒度掩码,强化了文本-区域对应关系并注入强空间先验。大量实验表明,Q-Mask在多种视觉场景下显著提升了文本定位与理解能力。

原文摘要 · Abstract (English)

Optical Character Recognition (OCR) is increasingly regarded as a foundational capability for modern vision-language models (VLMs), enabling them not only to read text in images but also to support downstream reasoning in real-world visual question answering (VQA). However, practical applications further require reliable text anchors, i.e., accurately grounding queried text to its corresponding spatial region. To systematically evaluate this capability, we introduce TextAnchor-Bench (TABench), a benchmark for fine-grained text-region grounding, which reveals that both general-purpose and OCR-specific VLMs still struggle to establish accurate and stable text anchors. To address this limitation, we propose Q-Mask, a precise OCR framework built upon a causal query-driven mask decoder (CQMD). Inspired by chain-of-thought reasoning, Q-Mask performs causal visual decoding that sequentially generates query-conditioned visual masks before producing the final OCR output. This visual CoT paradigm disentangles where the text is from what the text is, enforcing grounded evidence acquisition prior to recognition and enabling explicit text anchor construction during inference. To train CQMD, we construct TextAnchor-26M, a large-scale dataset of image-text pairs annotated with fine-grained masks corresponding to specific textual elements, encouraging stable text-region correspondences and injecting strong spatial priors into VLM training. Extensive experiments demonstrate that Q-Mask substantially improves text anchoring and understanding across diverse visual scenes.

OCR文本定位视觉语言模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。