arXiv:2410.21813cs.CV2024-10被引 4

用SAM2精准分割喉咽肿瘤,双Swin结构自适应增强特征

SAM-Swin: SAM-Driven Dual-Swin Transformers with Adaptive Lesion Enhancement for Laryngo-Pharyngeal Tumor Detection

  • 基于SAM2分割引导,双Swin架构融合多尺度特征
  • 在三个医院数据集上达到93.6%准确率,优于现有方法
  • 适合医学影像分析、肿瘤检测研究者使用

喉咽癌(LPC)是头颈部高致命性恶性肿瘤。尽管双分支网络通过整合全局与局部特征显著提升了诊断准确率,但在病灶精确定位及特征互补性利用方面仍存挑战。为此,我们提出SAM-Swin模型,该模型借助分割任意模型2(SAM2)的强分割能力实现病灶精准分割,并设计多尺度病灶感知增强模块(MS-LAEM),自适应提升各尺度下的互补特征学习质量;同时引入多尺度类别感知引导损失(CAG),提供多尺度针对性监督,强化类别特异性特征提取。为验证有效性,我们在中山大学附属第一医院(FAHSYSU)、第六附属医院(SAHSYSU)及南方医科大学南方医院(NHSMU)收集了三个LPC数据集:以FAHSYSU用于内部训练,另两者用于外部评估。大量实验表明,SAM-Swin优于当前最优方法,展现出推动LPC检测进步的巨大潜力。代码已公开于https://github.com/VVJia/SAM-Swin。

原文摘要 · Abstract (English)

Laryngo-pharyngeal cancer (LPC) is a highly lethal malignancy in the head and neck region. Recent advancements in tumor detection, particularly through dual-branch network architectures, have significantly improved diagnostic accuracy by integrating global and local feature extraction. However, challenges remain in accurately localizing lesions and fully capitalizing on the complementary nature of features within these branches. To address these issues, we propose SAM-Swin, an innovative SAM-driven Dual-Swin Transformer for laryngo-pharyngeal tumor detection. This model leverages the robust segmentation capabilities of the Segment Anything Model 2 (SAM2) to achieve precise lesion segmentation. Meanwhile, we present a multi-scale lesion-aware enhancement module (MS-LAEM) designed to adaptively enhance the learning of nuanced complementary features across various scales, improving the quality of feature extraction and representation. Furthermore, we implement a multi-scale class-aware guidance (CAG) loss that delivers multi-scale targeted supervision, thereby enhancing the model's capacity to extract class-specific features. To validate our approach, we compiled three LPC datasets from the First Affiliated Hospital (FAHSYSU), the Sixth Affiliated Hospital (SAHSYSU) of Sun Yat-sen University, and Nanfang Hospital of Southern Medical University (NHSMU). The FAHSYSU dataset is utilized for internal training, while the SAHSYSU and NHSMU datasets serve for external evaluation. Extensive experiments demonstrate that SAM-Swin outperforms state-of-the-art methods, showcasing its potential for advancing LPC detection and improving patient outcomes. The source code of SAM-Swin is available at the URL of \href{https://github.com/VVJia/SAM-Swin}{https://github.com/VVJia/SAM-Swin}.

肿瘤检测Transformer医学图像SAM2

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。