arXiv:2505.15504cs.CVcs.AI2025-05中稿 · ICLR被引 1

提出几何感知模块,解决病理图像少样本分类的过拟合问题。

Exploiting Low-Dimensional Manifold of Features for Few-Shot Whole Slide Image Classification

  • 用可插拔模块重构线性层,分离几何保持与任务适配路径
  • 在多个数据集上达到顶尖性能,参数量显著减少
  • 适合少样本医学图像分析研究者参考

少样本全切片图像(WSI)分类受过拟合严重制约。我们指出,这不仅是数据稀缺问题,更是根本性的几何问题。基于流形假设,分析表明病理基础模型特征呈现低维流形结构,易被下游模型破坏。实证发现,下游多实例学习模型中的线性层缺乏几何感知,会扭曲特征流形。为此,我们提出曼达洛残差(MR)模块,显式引入几何感知。该模块将线性层重构成残差学习,分两条路径:(1)固定随机矩阵作为几何锚点,近似保持拓扑结构并锐化特征谱;(2)可训练的低秩残差路径,用于任务特异性适应,其结构瓶颈明确反映特征的低有效秩。这种解耦施加了结构归纳偏置,将学习简化为更简单的残差拟合任务。大量实验表明,该方法在显著减少参数量的同时实现最优性能,为少样本WSI分类提供新范式。代码见 https://github.com/BearCleverProud/MR-Block。

原文摘要 · Abstract (English)

Few-shot Whole Slide Image (WSI) classification is severely hampered by overfitting. We argue that this is not merely a data-scarcity issue but a fundamentally geometric problem. Grounded in the manifold hypothesis, our analysis shows that features from pathology foundation models exhibit a low-dimensional manifold geometry that is easily perturbed by downstream models. This insight reveals a key potential issue in downstream multiple instance learning models: linear layers are geometry-agnostic and, as we show empirically, can distort the manifold geometry of the features. To address this, we propose the Manifold Residual (MR) block, a plug-and-play module that is explicitly geometry-aware. The MR block reframes the linear layer as residual learning and decouples it into two pathways: (1) a fixed, random matrix serving as a geometric anchor that approximately preserves topology while also acting as a spectral shaper to sharpen the feature spectrum; and (2) a trainable, low-rank residual pathway that acts as a residual learner for task-specific adaptation, with its structural bottleneck explicitly mirroring the low effective rank of the features. This decoupling imposes a structured inductive bias and reduces learning to a simpler residual fitting task. Through extensive experiments, we demonstrate that our approach achieves state-of-the-art results with significantly fewer parameters, offering a new paradigm for few-shot WSI classification. Code is available in https://github.com/BearCleverProud/MR-Block.

少样本学习医学图像流形学习模型压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。