用潜在概念表示正则化,让医学影像模型更可靠。
In-hoc Concept Representations to Regularise Deep Learning in Medical Imaging
- 用小样本合成高质量概念样本,引导模型关注语义特征
- 在糖尿病视网膜病变任务中提升对抗干扰和跨分布泛化能力
- 无需密集标注,适合缺乏标签的医疗场景
医学影像深度学习模型在分布内表现优异,但在分布外时易依赖虚假相关而非临床有意义特征。本文提出LCRReg,一种利用潜在概念表示(如概念激活向量)的正则化方法,无需主训练集中的概念标签,仅通过小规模辅助数据集生成高质量、解耦的概念实例。针对预定义的临床特征提取潜在概念表示,并引入正则项,引导卷积神经网络在对应概念潜空间内激活。在合成与真实医学任务上评估:在可控玩具数据集上显著提升对注入虚假相关性的鲁棒性,且在多概念、多分类场景下仍有效;在糖尿病视网膜病变二分类任务中,增强合成干扰和分布外泛化性能。相比多任务学习、线性探针及后处理概念模型等基线,LCRReg为轻量级、架构无关的鲁棒性提升策略,无需密集概念监督。代码已开源。
原文摘要 · Abstract (English)
Deep learning models in medical imaging often achieve strong in-distribution performance but struggle to generalise under distribution shifts, frequently relying on spurious correlations instead of clinically meaningful features. We introduce LCRReg, a novel regularisation approach that leverages Latent Concept Representations (LCRs) (e.g., Concept Activation Vectors (CAVs)) to guide models toward semantically grounded representations. LCRReg requires no concept labels in the main training set and instead uses a small auxiliary dataset to synthesise high-quality, disentangled concept examples. We extract LCRs for predefined relevant features, and incorporate a regularisation term that guides a Convolutional Neural Network (CNN) to activate within latent subspaces associated with those concepts. We evaluate LCRReg across synthetic and real-world medical tasks. On a controlled toy dataset, it significantly improves robustness to injected spurious correlations and remains effective even in multi-concept and multiclass settings. On the diabetic retinopathy binary classification task, LCRReg enhances performance under both synthetic spurious perturbations and out-of-distribution (OOD) generalisation. Compared to baselines, including multitask learning, linear probing, and post-hoc concept-based models, LCRReg offers a lightweight, architecture-agnostic strategy for improving model robustness without requiring dense concept supervision. Code is available at the following link: https://github.com/Trustworthy-AI-UU-NKI/lcr\_regularization
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。