arXiv:2608.17598cs.CV2026-08

通过加权对比学习,让医学影像模型摆脱设备伪相关干扰。

SpurCon: Weighted Supervised Contrastive Learning for Mitigating Spurious Cues in Medical Imaging

论文配图:SpurCon: Weighted Supervised Contrastive Learning for Mitigating Spurious Cues in Medical Imaging
图 1 · 摘自论文原文
  • 用元数据和伪标签快速识别伪线索,不需训练
  • 设计样本加权对比损失,使同病异伪的图像表征更相似
  • 适配预训练模型,仅微调轻量投影头,适合临床部署

尽管深度神经网络在视觉识别中进展迅速,但在高风险医疗应用中的采用仍受限于可靠性与鲁棒性问题。模型可能利用伪相关,尤其在医学影像中,设备或治疗痕迹常与病灶共现。小样本或不平衡数据集下,此类线索会进一步降低最差组表现,削弱临床信任。为解决此问题,需同时识别特定数据集的伪线索(通常需领域知识)并减轻对其依赖。本文提出SpurCon,一种基于新型有监督对比损失的轻量级框架,利用可用元数据与预测伪标签增强鲁棒性。我们引入无需训练的快速少样本方法,仅用少量专家标注样本即可估计伪标签。随后提出加权有监督对比目标WtSupCon,通过依赖[病灶, 伪线索, 元数据]组合的样本权重重塑表示几何结构。例如,仅在伪标签上不同的样本获得最高权重,使其表征高度相似。该方法作用于预训练图像编码器(如BiomedCLIP),仅训练轻量投影头。在合成设置及Waterbirds、CheXpert(胸部X光分类)、ISIC 2020(皮肤癌分类)数据集上评估,SpurCon在多个数据集上均实现最优伪线索缓解效果,兼顾最差组与整体准确率。

原文摘要 · Abstract (English)

Despite the rapid progress of deep neural networks in visual recognition, their adoption in high-risk medical applications remains limited due to reliability and robustness concerns. Models may exploit spurious correlations, particularly in medical imaging, where devices or treatment artifacts often co-occur with pathology. In small or imbalanced datasets, such cues further reduce worst-group performance and undermine clinical trust. To solve these issues, two major challenges should be addressed: identifying dataset-specific spurious cues, which typically require domain knowledge, and mitigating reliance on them. To tackle both, we propose SpurCon, a lightweight framework based on a novel supervised contrastive loss formulation that leverages available metadata and predicted spurious labels to enhance robustness. We introduce a fast few-shot procedure, without network training, to estimate spurious labels using a small number of expert-annotated samples. We then propose a weighted supervised contrastive objective, WtSupCon, that reshapes the representation geometry by assigning sample-specific weights that depend on the [pathology, spurious, metadata] combination. For example, the highest weight is assigned to samples that differ only in their spurious label. This yields highly similar representations for images with the same metadata and pathology, differing only in the predicted spurious label. Our method operates on pretrained image encoders (such as BiomedCLIP) and trains only a lightweight projection head. We evaluate SpurCon on a synthetic setting and on Waterbirds, CheXpert, a chest X-ray classification dataset, and ISIC 2020, a skin cancer classification dataset. Our approach delivers the best spurious-mitigation performance, balancing well worst-group and overall accuracy on multiple datasets.

医学影像伪相关对比学习鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。