arXiv:2606.24430cs.CVcs.AI2026-06

研究病理图像在潜在空间中对变换的响应,揭示编码器对变换不完全免疫。

Transformation Behavior of Images in Latent Space

论文配图:Transformation Behavior of Images in Latent Space
图 1 · 摘自论文原文
  • 对比原始与变换图像的潜在表示,评估编码鲁棒性
  • 不同编码器间差异显著,特定病理编码器表现更优
  • 结果解释为何数据增强能提升分类性能,适合医学图像研究者

病理图像分类模型训练通常依赖将图像编码至潜在空间以降低复杂度并提升性能。现有编码器包括在通用图像数据集(如ImageNet)预训练的模型,以及专为病理图像设计的模型。编码器应适配下游任务,实现对生物/诊断信息的编码,同时对标签无关的变换保持不变性。本文研究经典图像变换对潜在空间的影响,采用Lunit Inc.、Bioptimus及Meta Research Team提供的编码器,基于结直肠组织切片的H&E染色图像数据和公开的TCGA数据集,通过比较原始与变换图像嵌入,并与随机无关嵌入对比,评估嵌入的方差。结果显示,原始与变换图像的嵌入距离小于与随机嵌入的距离,表明编码具备一定鲁棒性。但嵌入并非完全不变,说明编码器未能完全消除变换影响,解释了为何基于变换的数据增强仍能提升模型性能。此外,通用编码器与病理专用编码器之间存在显著差异。

原文摘要 · Abstract (English)

Training of neural networks for histopathology classification tasks typically relies on data encoding into latent space, which reduces complexity and improves performance. There are several encoder networks available, either pretrained on general image datasets such as ImageNET, or specifically on histopathological images. Training of encoder networks should be adapted to downstream tasks, allowing encoding of biologic/diagnostic content while rendering networks invariant to label-irrelevant transformations. This paper investigates the effect of classical image transformation on the latent space, using networks provided by Lunit Inc. and Bioptimus, both focusing on pathological images, and by Meta Research Team. We assess variance of embeddings resulting from standard data transformations by comparing original and transformed image embeddings and by contrasting them with random, unrelated embeddings, using image tiles from hematoxylin/eosin-stained sections available in a colorectal tissue dataset and the publicly accessible TCGA dataset. Our findings show that embeddings of original and transformed images are closer to each other than to random embeddings, indicating robustness to transformations. However, they are not fully invariant, revealing that the encoder networks do not completely neutralize transformation effects in latent space, explaining why transformation-mediated augmentation of datasets can improve performance. Significant differences were observed between general and histopathology-specific encoder networks.

病理图像潜在空间编码器数据增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。