融合SAM2与Mamba的双编码器模型,提升心脏MRI分割精度。
SAMba-UNet: SAM2-Mamba UNet for Cardiac MRI in Medical Robotic Perception
- 结合SAM2、Mamba与UNet,实现跨模态特征协同学习。
- 在ACDC数据集上达Dice 0.9103、HD95 1.0859mm,右心室定位更准。
- 适合医疗机器人感知系统,支持术前规划与术中导航。
为解决自动化心脏MRI分割中复杂病灶特征提取难题,提出SAMba-UNet,一种融合视觉基础模型SAM2、线性复杂度状态空间模型Mamba与经典UNet的双编码器架构,实现跨模态协同特征学习;为缓解自然图像与医学影像间的域偏移,引入动态特征融合精炼器,通过多尺度池化与通道-空间双路径校准强化小病灶与细结构表征;设计异质全注意力收敛模块(HOACM),利用全局上下文注意力与分支选择性强调,融合SAM2的局部位置语义与Mamba的长程依赖建模能力,显著提升全局一致性与边界精度;在ACDC心脏MRI基准上,SAMba-UNet取得Dice 0.9103、HD95 1.0859 mm的性能,对右心室等挑战性结构的边界定位尤为优越;其鲁棒且高保真的分割结果可直接作为智能医疗与手术机器人系统的感知模块,支持术前规划、术中导航及术后并发症筛查;代码将开源,促进临床转化与进一步验证。
原文摘要 · Abstract (English)
To address complex pathological feature extraction in automated cardiac MRI segmentation, we propose SAMba-UNet, a novel dual-encoder architecture that synergistically combines the vision foundation model SAM2, the linear-complexity state-space model Mamba, and the classical UNet to achieve cross-modal collaborative feature learning; to overcome domain shifts between natural images and medical scans, we introduce a Dynamic Feature Fusion Refiner that employs multi-scale pooling and channel-spatial dual-path calibration to strengthen small-lesion and fine-structure representation, and we design a Heterogeneous Omni-Attention Convergence Module (HOACM) that fuses SAM2's local positional semantics with Mamba's long-range dependency modeling via global contextual attention and branch-selective emphasis, yielding substantial gains in both global consistency and boundary precision-on the ACDC cardiac MRI benchmark, SAMba-UNet attains a Dice of 0.9103 and HD95 of 1.0859 mm, notably improving boundary localization for challenging structures like the right ventricle, and its robust, high-fidelity segmentation maps are directly applicable as a perception module within intelligent medical and surgical robotic systems to support preoperative planning, intraoperative navigation, and postoperative complication screening; the code will be open-sourced to facilitate clinical translation and further validation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。