arXiv:2606.17412cs.CVcs.AI2026-06被引 2

让病理视觉模型学会多尺度推理,提升诊断准确性。

Enhancing Pathological VLMs with Cross-scale Reasoning

论文配图:Enhancing Pathological VLMs with Cross-scale Reasoning
图 1 · 摘自论文原文
  • 设计多倍率图像问答任务,引导模型跨尺度整合病理证据。
  • 构建4685个高质量问题的Scale-VQA基准,解决文本捷径问题。
  • 新模型在多尺度与单尺度任务上均达顶尖水平,适合医疗AI研究者。

病理图像具有天然的多尺度特性,需结合低倍率下的组织结构全局信息与高倍率下的细胞形态细节进行准确诊断。现有病理视觉语言模型(VLM)数据集虽涵盖多种倍率,但缺乏明确的跨尺度推理目标,导致模型难以学习基于证据的跨尺度表征。为此,我们提出首个跨尺度训练与评估范式,将病理解读定义为多倍率推理任务。然而,多图视觉问答(VQA)易受文本捷径影响,模型可能仅依赖倍率相关伪信号而非真实视觉证据作答。为此,我们设计了防泄漏的筛选流程,结合对抗性纯文本筛查与约束引导的问题设计。基于此,我们构建了Scale-VQA基准,包含4,685道多项选择题,覆盖2,537张病理图像,覆盖多个倍率层级。最后,我们提出ScaleReasoner-R1,一种通过强化学习优化跨尺度VQA性能的模型。该模型在跨尺度基准上达到当前最优,并在既有单尺度基准上也表现卓越。结果表明,即使仅有有限的跨尺度监督,也能显著提升病理理解能力。代码已开源:https://github.com/iMVR-PL/ScaleReasoner-R1。

原文摘要 · Abstract (English)

Pathological images are inherently multi-scale, requiring pathologists to integrate evidence from global tissue architecture at low magnification to cellular morphology at higher magnification for accurate diagnosis. While existing pathological datasets for vision-language models (VLMs) include various scales, they often lack explicit cross-scale reasoning objectives. This limitation prevents VLMs from capturing essential cross-scale representations and learning evidence-based reasoning. To bridge this gap, we introduce the first cross-scale training and evaluation paradigm that formulates pathology interpretation as multi-magnification reasoning. However, creating such a task reveals a critical challenge: multi-image visual question answering (VQA) is prone to text-only shortcuts, which allow models to guess answers using magnification-dependent artifacts rather than visual evidence. To address this, we propose a leakage-aware curation pipeline that combines adversarial text-only screening with constraint-guided question design. Using this pipeline, we construct Scale-VQA, a high-quality benchmark with 4,685 multiple-choice questions grounded in 2,537 pathology images across multiple magnification levels. Finally, we present ScaleReasoner-R1, a model trained via reinforcement learning to optimize performance on cross-scale VQA tasks. ScaleReasoner-R1 achieves state-of-the-art performance on our cross-scale reasoning benchmark and generalizes to SOTA performance on established single-scale benchmarks. Findings suggest that even the limited cross-scale supervision can significantly improve pathological understanding. Code is available at https://github.com/iMVR-PL/ScaleReasoner-R1.

病理分析多尺度推理视觉语言模型医学AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。