arXiv:2505.19319cs.CV2025-05中稿 · MICCAI 2025被引 4

无需对齐图像,用细粒度知识蒸馏提升白光肠镜判别准确率

Holistic White-light Polyp Classification via Alignment-free Dense Distillation of Auxiliary Optical Chromoendoscopy

  • 提出无对齐密集蒸馏模块,直接在全图上迁移窄带成像知识
  • 在公开与自建数据集上AUC最高提升16.2%,显著优于现有方法
  • 适合资源有限地区,无需精准定位病灶即可实现高精度分类

白光成像(WLI)和窄带成像(NBI)是结肠镜检查中用于息肉分类的两种主要模态。尽管NBI作为光学染色内镜可提供有价值的血管信息,但WLI仍是资源匮乏地区最常见甚至唯一的可用模态。然而,基于WLI的方法通常表现较差,限制了其临床应用。现有方法通过全局特征对齐将NBI知识迁移到WLI,但常依赖裁剪的病灶区域,易受检测误差影响,并忽略上下文及细微诊断线索。为此,本文提出一种新型整体分类框架,利用无需息肉定位的全图诊断。核心创新为无对齐密集蒸馏(ADD)模块,可在WLI与NBI图像未对齐情况下实现细粒度跨域知识蒸馏。ADD不依赖显式图像对齐,通过学习像素级跨域亲和性建立特征图间的对应关系,引导沿最相关像素路径进行蒸馏。为增强蒸馏可靠性,ADD引入类别激活图(CAM)过滤跨域亲和性,确保仅语义一致且对诊断贡献相当的区域参与蒸馏。在公开及自建数据集上的大量实验表明,本方法达到当前最优性能,相对其他方法在AUC上分别至少提升2.5%和16.2%。代码已开源:https://github.com/Huster-Hq/ADD。

原文摘要 · Abstract (English)

White Light Imaging (WLI) and Narrow Band Imaging (NBI) are the two main colonoscopic modalities for polyp classification. While NBI, as optical chromoendoscopy, offers valuable vascular details, WLI remains the most common and often the only available modality in resource-limited settings. However, WLI-based methods typically underperform, limiting their clinical applicability. Existing approaches transfer knowledge from NBI to WLI through global feature alignment but often rely on cropped lesion regions, which are susceptible to detection errors and neglect contextual and subtle diagnostic cues. To address this, this paper proposes a novel holistic classification framework that leverages full-image diagnosis without requiring polyp localization. The key innovation lies in the Alignment-free Dense Distillation (ADD) module, which enables fine-grained cross-domain knowledge distillation regardless of misalignment between WLI and NBI images. Without resorting to explicit image alignment, ADD learns pixel-wise cross-domain affinities to establish correspondences between feature maps, guiding the distillation along the most relevant pixel connections. To further enhance distillation reliability, ADD incorporates Class Activation Mapping (CAM) to filter cross-domain affinities, ensuring the distillation path connects only those semantically consistent regions with equal contributions to polyp diagnosis. Extensive results on public and in-house datasets show that our method achieves state-of-the-art performance, relatively outperforming the other approaches by at least 2.5% and 16.2% in AUC, respectively. Code is available at: https://github.com/Huster-Hq/ADD.

医学图像知识蒸馏结肠镜无监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。