arXiv:2605.31591cs.CV2026-05中稿 · CVPR

用专家模型的语义信息训练可部署的皮肤癌筛查模型

CoFiDA-M: Concept-Aware Feature Modulation for Cross-Domain Adaptation with Image-Only Inference

论文配图:CoFiDA-M: Concept-Aware Feature Modulation for Cross-Domain Adaptation with Image-Only Inference
图 1 · 摘自论文原文
  • 用概念概率指导特征调制,训练时引入额外语义信息
  • 图像仅输入的学生模型在多数据集上显著提升黑色素瘤检出率
  • 适合需真实场景部署的医疗视觉模型开发人员

基于AI的皮肤癌筛查模型在从专业皮肤镜图像(源域)转移到消费级临床图像(目标域)时性能严重下降,阻碍实际应用。现有领域自适应方法常忽略关键语义不变量,如临床概念。虽然新基础模型如MONET能提供密集的、概率性的概念得分,但这些元数据在测试时不可用,造成部署困境。我们提出CoFiDA-M,一种特权信息框架:训练时利用MONET概念概率指导教师网络,通过FiLM调制器将视觉特征转换为语义“编辑”空间;再训练一个轻量级图像仅输入的学生模型,复现该编辑后的表示而非仅预测结果。这种蒸馏将临床推理“嵌入”学生权重中。在多数据集基准测试中,图像仅输入的学生模型显著优于当前最优方法,尤其在黑色素瘤召回率上表现突出。本工作展示了利用噪声、概率性元数据作为特权信息的实用且可泛化的方法,具备强跨数据集鲁棒性,适用于超越皮肤病学的实际部署场景。代码已开源:https://github.com/mmu-dermatology-research/CoFiDA.git

原文摘要 · Abstract (English)

Models for AI-based skin cancer screening suffer a severe performance drop when shifting from expert dermoscopic (source) images to consumer-grade clinical (target) images, hindering real-world deployment. Existing domain adaptation methods often ignore crucial semantic invariants, such as clinical concepts. While new foundation models like MONET can provide this semantic information as dense, probabilistic scores, this metadata is unavailable at test time, creating a deployment paradox for practical image-only screening tools. We address this gap by proposing CoFiDA-M, a privileged information framework that learns from concepts at training time but deploys as an image-only model. Our method trains a teacher network that uses MONET concept probabilities to guide a FiLM modulator, transforming visual features into a semantically ``edited" feature space. A lightweight, image-only student is then trained to reproduce this edited representation, not just the teacher's final predictions. This distillation ``bakes" the clinical reasoning into the student's weights. On a challenging multi-dataset benchmark, our image-only student significantly outperforms state-of-the-art approaches, especially in melanoma recall. Our work provides a practical and generalizable framework for leveraging noisy, probabilistic metadata as privileged information, demonstrating strong cross-dataset robustness and potential for real-world deployment beyond dermatology. Implementation code is available at: https://github.com/mmu-dermatology-research/CoFiDA.git

领域自适应医疗影像概念学习模型蒸馏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。