arXiv:2508.15904cs.CV2025-08

用少样本提示调优提升罕见癌症分型准确率

Boosting Pathology Foundation Models via Few-shot Prompt-tuning for Rare Cancer Subtyping

  • 通过空间感知视觉聚合与任务特定提示调优,实现跨模态推理
  • 在8个罕见癌数据集上显著提升分型准确率与病灶定位能力
  • 适合资源有限、专家稀缺的罕见癌症诊断场景

罕见癌症占所有恶性肿瘤的20-25%,但在儿科肿瘤中占比超70%,因专家资源匮乏而面临严峻诊断挑战。尽管病理视觉语言(VL)基础模型在常见癌症分型上展现零样本潜力,其对罕见癌症的临床表现仍受限。现有多实例学习(MIL)方法仅依赖视觉特征,忽视跨模态知识,削弱了可解释性。为此,我们提出PathPT框架,通过空间感知视觉聚合和任务特定提示调优,充分挖掘视觉语言病理基础模型潜力。不同于传统MIL,PathPT利用VL模型的零样本能力,将全切片(WSI)级监督转化为细粒度瓦片级指导,保留癌变区域定位信息,并通过与组织病理学术语对齐的提示实现跨模态推理。我们在八个罕见癌数据集(四个成人、四个儿童)共56种亚型、2,910张全切片图像上进行评估,涵盖三种常见癌数据集,测试四种先进VL模型与四种MIL框架,在三种少样本设置下验证。结果表明,PathPT持续取得更优性能,显著提升分型准确率与癌变区域定位能力。本研究推动罕见癌症的AI辅助诊断,为缺乏专科专家的环境提供可扩展的解决方案。

原文摘要 · Abstract (English)

Rare cancers comprise 20-25% of all malignancies but face major diagnostic challenges due to limited expert availability-especially in pediatric oncology, where they represent over 70% of cases. While pathology vision-language (VL) foundation models show promising zero-shot capabilities for common cancer subtyping, their clinical performance for rare cancers remains limited. Existing multi-instance learning (MIL) methods rely only on visual features, overlooking cross-modal knowledge and compromising interpretability critical for rare cancer diagnosis. To address this limitation, we propose PathPT, a novel framework that fully exploits the potential of vision-language pathology foundation models through spatially-aware visual aggregation and task-specific prompt tuning. Unlike conventional MIL, PathPT converts WSI-level supervision into fine-grained tile-level guidance by leveraging the zero-shot capabilities of VL models, thereby preserving localization on cancerous regions and enabling cross-modal reasoning through prompts aligned with histopathological semantics. We benchmark PathPT on eight rare cancer datasets(four adult and four pediatric) spanning 56 subtypes and 2,910 WSIs, as well as three common cancer datasets, evaluating four state-of-the-art VL models and four MIL frameworks under three few-shot settings. Results show that PathPT consistently delivers superior performance, achieving substantial gains in subtyping accuracy and cancerous region grounding ability. This work advances AI-assisted diagnosis for rare cancers, offering a scalable solution for improving subtyping accuracy in settings with limited access to specialized expertise.

罕见癌症视觉语言模型少样本学习病理图像分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。