用预训练分割模型引导分类器关注医学图像中的解剖结构,提升诊断准确性。
Learning To Focus: Anatomy-Guided Attention Regularization for Medical Image Classification

- 利用预训练分割模型提取解剖先验,无需额外标注
- 通过注意力正则化使分类器更关注解剖前景区域
- 在8个数据集上提升性能,适合医学图像分类任务
医学图像分类模型应能识别与诊断相关区域,但标准分类损失缺乏空间监督。虽可通过解剖结构分割图进行显式指导,但手动标注成本高。随着分割基础模型在多种成像模态中展现出强解剖定位能力,本文提出Locus框架,利用这些预训练模型提取解剖形状先验,无需训练专用分割模型。Locus不强制像素级对齐,而是引入正则化项,自适应平衡前景(解剖)与背景注意力,当背景注意力占优时施加惩罚。在涵盖皮肤镜、X光、病理切片和心脏MRI的8个医学影像数据集上验证,该方法在分类性能上实现一致提升,并增强注意力的解剖学合理性。
原文摘要 · Abstract (English)
Medical image classification models are ideally expected to identify diagnostically relevant regions while making predictions, yet standard classification losses rarely provide spatial supervision. Explicit supervision via anatomical shape information, such as segmentation masks of task-relevant anatomy, has been shown to guide the network toward regions relevant to the target prediction. However, obtaining such masks incurs substantial manual annotation effort and computational overhead. With the advent of segmentation foundation models that exhibit strong localization of anatomical structures across diverse imaging modalities, we leverage this capability to extract anatomical shape priors without the burden of training a dedicated segmentation model. In this paper, we propose a new framework, Locus, an anatomical attention regularization framework that leverages pretrained segmentation foundation models to guide a classifier's attention toward diagnostically meaningful anatomical structures across diverse imaging modalities. Instead of enforcing pixel-wise alignment with the foundation-model-derived mask, we introduce a regularization term that adaptively balances attention between anatomical (foreground) and background regions, penalizing the classifier when background attention dominates. We validate Locus on eight diverse medical imaging datasets spanning dermoscopy, X-ray, histopathology, and cardiac MRI, showing consistent gains in classification performance alongside improved anatomically grounded attention.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。