arXiv:2411.14743cs.CVcs.AI2024-11CVPR被引 34

用知识增强的自适应压缩,让少量病理图像也能精准识别癌症。

FOCUS: Knowledge-enhanced Adaptive Visual Compression for Few-shot Whole Slide Image Classification

  • 结合病理基础模型与语言先验,动态筛选关键病灶区域。
  • 在乳腺、肺和卵巢癌数据集上,少样本分类准确率显著提升。
  • 适合资源有限但需高精度病理诊断的研究者使用。

少样本学习为计算病理学中的癌症诊断提供了重要解决方案,缓解了标注数据稀缺与患者隐私限制等根本问题。其核心挑战在于全切片图像(WSI)训练集规模有限,而图像包含大量病灶无关的像素块,可能稀释模型对关键诊断特征的学习能力。尽管已有研究尝试引入额外知识,但仍存在两大瓶颈:(1)强大的病理基础模型(FMs)仅被用于简单特征提取,潜力未充分挖掘;(2)现有语言引导机制试图一次性对海量WSI块进行文本对齐,难以有效利用丰富的病理语义信息。为此,我们提出知识增强的自适应视觉压缩框架FOCUS,首次将病理基础模型与语言先验融合,实现对诊断相关区域的聚焦分析,通过优先保留判别性图像块。该方法采用三阶段渐进式压缩策略:首先利用基础模型消除全局视觉冗余,再将压缩特征与语言提示结合进行语义相关性评估,最后基于邻域感知进行视觉令牌过滤并保持空间一致性。在涵盖乳腺、肺和卵巢癌的多个病理数据集上的实验表明,该方法在少样本病理诊断任务中表现优异。代码已开源:https://github.com/dddavid4real/FOCUS。

原文摘要 · Abstract (English)

Few-shot learning presents a critical solution for cancer diagnosis in computational pathology (CPath), addressing fundamental limitations in data availability, particularly the scarcity of expert annotations and patient privacy constraints. A key challenge in this paradigm stems from the inherent disparity between the limited training set of whole slide images (WSIs) and the enormous number of contained patches, where a significant portion of these patches lacks diagnostically relevant information, potentially diluting the model's ability to learn and focus on critical diagnostic features. While recent works attempt to address this by incorporating additional knowledge, several crucial gaps hinder further progress: (1) despite the emergence of powerful pathology foundation models (FMs), their potential remains largely untapped, with most approaches limiting their use to basic feature extraction; (2) current language guidance mechanisms attempt to align text prompts with vast numbers of WSI patches all at once, struggling to leverage rich pathological semantic information. To this end, we introduce the knowledge-enhanced adaptive visual compression framework, dubbed FOCUS, which uniquely combines pathology FMs with language prior knowledge to enable a focused analysis of diagnostically relevant regions by prioritizing discriminative WSI patches. Our approach implements a progressive three-stage compression strategy: we first leverage FMs for global visual redundancy elimination, and integrate compressed features with language prompts for semantic relevance assessment, then perform neighbor-aware visual token filtering while preserving spatial coherence. Extensive experiments on pathological datasets spanning breast, lung, and ovarian cancers demonstrate its superior performance in few-shot pathology diagnosis. Codes are available at https://github.com/dddavid4real/FOCUS.

少样本学习病理图像视觉压缩知识增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。