arXiv:2605.30716cs.CVcs.AI2026-05

用轻量模型高效生成病理报告,解决高分辨率图像的计算难题。

Simple Token-Efficient Vision-Language Model for Case-level Pathology Synoptic Report Generation

论文配图:Simple Token-Efficient Vision-Language Model for Case-level Pathology Synoptic Report Generation
图 1 · 摘自论文原文
  • 三组件设计:冻结编码器+轻量对齐器+大语言模型解码器
  • 仅需半张H100显卡即可训练,序列长度压缩64倍
  • 适合资源有限但需多切片病理报告生成的研究场景

从全幻灯片图像(WSIs)生成临床有用的病理报告极具挑战,因图像分辨率高达千兆像素、视觉标记序列过长,且病例级推理复杂——单个病例可能包含多个具有异质组织和模糊发现的WSI。本文提出一种简洁的令牌高效视觉-语言模型,适用于受限GPU内存环境下的病例级结构化报告生成。架构采用最小三组件设计:冻结的病理切片编码器、轻量级两层MLP视觉-语言对齐器,以及大语言模型解码器,并引入显式WSI标记令牌以区分同一病例中的不同切片。训练分两阶段进行:(1) 仅对齐器使用异构WSI-文本对进行切片描述训练;(2) 在病例-报告对上进行病例级监督微调以生成结构化报告。为减少序列长度,每张切片使用512×512像素的5×放大率切片,相比常用的20×切片,平均序列长度降低达64倍。结合高效的训练技术,仅需半张NVIDIA H100 GPU即可实现实际训练。在两个训练阶段中,模型均取得高ROUGE-L/METEOR/BLEU-4分数,且在内存与运行时间上显著更优。在AI评估中,模型持续优于强基线。大量消融实验揭示了性能-效率权衡,并识别出提升多WSI场景鲁棒性的简单策略。本工作为高效病理报告生成提供了强大且可复现的基线,降低了有限算力下多WSI视觉-语言模型研究的门槛。代码已开源:https://github.com/AtlasAnalyticsLab/PathoSynVLM。

原文摘要 · Abstract (English)

Generating clinically useful pathology reports for pathology cases from whole-slide images (WSIs) is challenging due to gigapixel resolution, long visual-token sequences, and the complexity of case-level reasoning, where a single case may contain multiple WSIs with heterogeneous tissues and ambiguous findings. We present a simple token-efficient vision--language model for case-level synoptic report generation that remains practical under constrained GPU memory. Our architecture follows a minimal three-component design: a frozen pathology patch encoder, a lightweight two-layer MLP vision-language aligner, and a large language model decoder, with an explicit WSI marker token to separate slides within a case. Training proceeds in two supervised stages: (1) aligner-only WSI captioning using heterogeneous WSI-text pairs, and (2) case-level supervised fine-tuning on case-report pairs for structured report generation. To reduce sequence length, we represent each slide using $512 \times 512$ patches at $5\times$ magnification, which reduces the average sequence length by up to $64\times$ times compared to the commonly used $20\times$ patches. Combined with efficient training techniques, we enable practical training with only half a NVIDIA H100 GPU. Across both training stages, our approach achieves high ROUGE-L/METEOR/BLEU-4 scores while being substantially more efficient in memory and runtime. In AI-based evaluations, our model is consistently preferred over strong baselines. Extensive ablations characterize performance-efficiency trade-offs and identify simple choices that improve robustness in multi-WSI settings. Overall, this work provides a strong, reproducible baseline for efficient pathology report generation, lowering the barrier to multi-WSI VLM research under limited compute. Code is available at https://github.com/AtlasAnalyticsLab/PathoSynVLM.

病理报告视觉语言模型轻量模型多切片

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。