arXiv:2410.14821cs.CV2024-10中稿 · Machine Learning i…

提升内镜图像跨域泛化能力,让模型在不同设备下仍能准确分割病灶。

Tackling domain generalization for out-of-distribution endoscopic imaging

  • 结合风格与内容信息,用归一化和特征协方差保留通用特征。
  • 在端到端训练中实现13.7%和19%的性能提升,优于基线和现有SOTA。
  • 适合医疗图像分割、跨域泛化研究者,尤其关注内镜数据分析场景。

尽管深度学习在单中心、单模态内镜图像分割上取得进展,但对未见分布或模态的数据泛化能力较差。现有方法多针对自然场景,难以直接应用于视觉线索更有限的内镜数据。本文通过实例归一化和特征协方差映射,同时利用图像风格与内容信息,构建鲁棒且可泛化的特征表示。为避免丢失关键病灶特征,设计了重建模块嵌入ResNet主干网络,保留任务相关特征。在EndoUDA结肠息肉数据集上,相比DeepLabv3+基线提升13.7%,接近现有SOTA提升8%;在端口反流性食管炎(BE)数据集上,较基线提升19%,优于最优SOTA 6%。

原文摘要 · Abstract (English)

While recent advances in deep learning (DL) for surgical scene segmentation have yielded promising results on single-center and single-imaging modality data, these methods usually do not generalize well to unseen distributions or modalities. Even though human experts can identify visual appearances, DL methods often fail to do so when data samples do not follow a similar distribution. Current literature addressing domain gaps in modality changes has focused primarily on natural scene data. However, these methods cannot be directly applied to endoscopic data, as visual cues in such data are more limited compared to natural scenes. In this work, we exploit both style and content information in images by performing instance normalization and feature covariance mapping techniques to preserve robust and generalizable feature representations. Additionally, to avoid the risk of removing salient feature representations associated with objects of interest, we introduce a restitution module within the feature-learning ResNet backbone that retains useful task-relevant features. Our proposed method shows a 13.7% improvement over the baseline DeepLabv3+ and nearly an 8% improvement over recent state-of-the-art (SOTA) methods for the target (different modality) set of the EndoUDA polyp dataset. Similarly, our method achieved a 19% improvement over the baseline and 6% over the best-performing SOTA method on the EndoUDA Barrett's esophagus (BE) dataset.

医学图像跨域泛化分割内镜

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。