提出跨模态交互网络CIPA,提升肺肿瘤在低质PET-CT图像中的分割精度
Cross-Modal Interactive Perception Network with Mamba for Lung Tumor Segmentation in PET-CT Images
- 设计通道级修正模块与动态跨模态交互机制,融合代谢与解剖信息
- 在21,930对图像的PCLT20K数据集上实现优于当前最优方法的分割性能
- 开源数据集与代码,适合医学图像分割与多模态模型研究者使用
肺癌是全球癌症死亡的主要原因。PET-CT在肺肿瘤成像中至关重要,可提供关键的代谢与解剖信息,但存在图像质量差、运动伪影及肿瘤形态复杂等挑战。深度学习模型有望解决这些问题,然而现有小规模私有数据集限制了性能提升。为此,我们构建了一个大规模肺肿瘤分割数据集PCLT20K,包含605名患者的21,930对PET-CT图像。同时提出一种基于Mamba的跨模态交互感知网络(CIPA)。具体而言,设计通道级修正模块(CRM),通过跨模态特征的通道状态空间块学习相关表示,过滤模态特异性噪声;提出动态跨模态交互模块(DCIM),利用PET图像学习区域位置信息,并作为桥梁辅助建模CT图像局部特征间关系。在综合基准测试中,实验验证了CIPA优于当前最优分割方法。研究希望为医学图像分割提供更多探索机会。数据集与代码已开源:https://github.com/mj129/CIPA。
原文摘要 · Abstract (English)
Lung cancer is a leading cause of cancer-related deaths globally. PET-CT is crucial for imaging lung tumors, providing essential metabolic and anatomical information, while it faces challenges such as poor image quality, motion artifacts, and complex tumor morphology. Deep learning-based models are expected to address these problems, however, existing small-scale and private datasets limit significant performance improvements for these methods. Hence, we introduce a large-scale PET-CT lung tumor segmentation dataset, termed PCLT20K, which comprises 21,930 pairs of PET-CT images from 605 patients. Furthermore, we propose a cross-modal interactive perception network with Mamba (CIPA) for lung tumor segmentation in PET-CT images. Specifically, we design a channel-wise rectification module (CRM) that implements a channel state space block across multi-modal features to learn correlated representations and helps filter out modality-specific noise. A dynamic cross-modality interaction module (DCIM) is designed to effectively integrate position and context information, which employs PET images to learn regional position information and serves as a bridge to assist in modeling the relationships between local features of CT images. Extensive experiments on a comprehensive benchmark demonstrate the effectiveness of our CIPA compared to the current state-of-the-art segmentation methods. We hope our research can provide more exploration opportunities for medical image segmentation. The dataset and code are available at https://github.com/mj129/CIPA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。