arXiv:2603.21504cs.CV2026-03中稿 · CVPR

轻量提示调优+层级文本引导,提升病理切片少样本分类效果

Parameter-efficient Prompt Tuning and Hierarchical Textual Guidance for Few-shot Whole Slide Image Classification

  • 通过特征缩放与偏移实现参数高效提示调优,降低计算开销
  • 在乳腺、肺、卵巢癌数据集上分别提升10.9%、7.8%、13.8%准确率
  • 保留低对齐实例信息,适合少标注病理图像分析场景

全切片图像(WSI)尺度达千兆像素,通常被分割为小块用于分类,但获取大量块级标注成本高昂,因此少样本弱监督WSI分类(FSWC)至关重要。现有方法依赖预训练视觉语言模型(VLMs),但存在提示调优参数多、推理开销大,且丢弃低对齐块导致信息损失的问题。本文提出两项改进:一是基于文本编码器特征缩放与偏移的参数高效提示调优,显著降低计算成本;二是引入软层次文本引导策略,利用WSI固有层级结构,不进行硬实例过滤以保留信息。在乳腺、肺及卵巢癌病理数据集上的实验表明,本方法相较当前最优方法分别提升10.9%、7.8%、13.8%性能。同时,训练参数减少18.1%(乳腺/肺)和5.8%(卵巢癌),并具备优异的弱监督肿瘤定位能力。

原文摘要 · Abstract (English)

Whole Slide Images (WSIs) are giga-pixel in scale and are typically partitioned into small instances in WSI classification pipelines for computational feasibility. However, obtaining extensive instance level annotations is costly, making few-shot weakly supervised WSI classification (FSWC) crucial for learning from limited slide-level labels. Recently, pre-trained vision-language models (VLMs) have been adopted in FSWC, yet they exhibit several limitations. Existing prompt tuning methods in FSWC substantially increase both the number of trainable parameters and inference overhead. Moreover, current methods discard instances with low alignment to text embeddings from VLMs, potentially leading to information loss. To address these challenges, we propose two key contributions. First, we introduce a new parameter efficient prompt tuning method by scaling and shifting features in text encoder, which significantly reduces the computational cost. Second, to leverage not only the pre-trained knowledge of VLMs, but also the inherent hierarchical structure of WSIs, we introduce a WSI representation learning approach with a soft hierarchical textual guidance strategy without utilizing hard instance filtering. Comprehensive evaluations on pathology datasets covering breast, lung, and ovarian cancer types demonstrate consistent improvements up-to 10.9%, 7.8%, and 13.8% respectively, over the state-of-the-art methods in FSWC. Our method reduces the number of trainable parameters by 18.1% on both breast and lung cancer datasets, and 5.8% on the ovarian cancer dataset, while also excelling at weakly-supervised tumor localization. Code at https://github.com/Jayanie/HIPSS.

少样本学习病理图像视觉语言模型提示调优

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。