arXiv:2511.05034cs.CVcs.AI2025-11被引 1

用动态残差编码和滑片对比学习,实现全切片图像端到端表征。

Dynamic Residual Encoding with Slide-Level Contrastive Learning for End-to-End Whole Slide Image Representation

  • 用记忆库存储备份所有切片特征,训练时随机采样+召回
  • 通过残差融合采样与记忆特征,生成滑片级表示
  • 适合癌症分型、识别与突变预测,可处理海量切片数据

全切片图像(WSI)表征对癌症亚型分类、癌症识别和突变预测至关重要。由于标准瓦片图可达数百万像素,包含数万张图像瓦片,当前GPU限制下难以在单个批次中计算所有瓦片的梯度。为此,我们提出动态残差编码与滑片级对比学习(DRE-SLCL)方法,用于端到端的WSI表征。该方法使用记忆库存储数据集中所有WSI的瓦片特征。训练时,一个批次通常包含多个WSI;对每个WSI,随机采样部分瓦片并用瓦片编码器计算其特征,再从记忆库中检索同张滑片的额外瓦片特征。通过残差编码技术融合采样与记忆特征,生成每个滑片的表示。最后,基于批次内滑片的表示和病理报告,计算滑片级对比损失。在癌症亚型分类、癌症识别和突变预测任务上的实验验证了DRE-SLCL的有效性。

原文摘要 · Abstract (English)

Whole Slide Image (WSI) representation is critical for cancer subtyping, cancer recognition and mutation prediction.Training an end-to-end WSI representation model poses significant challenges, as a standard gigapixel slide can contain tens of thousands of image tiles, making it difficult to compute gradients of all tiles in a single mini-batch due to current GPU limitations. To address this challenge, we propose a method of dynamic residual encoding with slide-level contrastive learning (DRE-SLCL) for end-to-end WSI representation. Our approach utilizes a memory bank to store the features of tiles across all WSIs in the dataset. During training, a mini-batch usually contains multiple WSIs. For each WSI in the batch, a subset of tiles is randomly sampled and their features are computed using a tile encoder. Then, additional tile features from the same WSI are selected from the memory bank. The representation of each individual WSI is generated using a residual encoding technique that incorporates both the sampled features and those retrieved from the memory bank. Finally, the slide-level contrastive loss is computed based on the representations and histopathology reports ofthe WSIs within the mini-batch. Experiments conducted over cancer subtyping, cancer recognition, and mutation prediction tasks proved the effectiveness of the proposed DRE-SLCL method.

WSI表征对比学习医学图像残差编码

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。