arXiv:2505.06133cs.CV2025-05

提出自动分割脑部病灶的新模型,提升小病灶识别准确率

BrainSegDMlF: A Dynamic Fusion-enhanced SAM for Brain Lesion Segmentation

  • 动态多模态融合机制,整合多种影像信息增强特征表达
  • 分层上采样解码器,在数据少时仍可精准检测微小病灶
  • 无需人工提示自动出分割图,适合临床快速诊断场景

脑部大范围病灶分割在医学图像分析中具有重要意义但挑战巨大。病灶区域与正常脑组织边界模糊,单切片中小病灶难以识别,导致精准且可重复的分割及特征描述极为复杂。现有方法存在三大局限:仅依赖单一模态信息,忽视诊断中常用的多模态数据;受限于数据量,对小病灶敏感性低,难以捕捉细微病理变化;基于SAM的模型依赖外部提示,无法实现全自动分割,影响诊断效率。为此,我们提出名为BrainSegDMLF的大规模全自动脑病灶分割模型。该模型具备三项核心特性:1)动态模态交互融合(DMIF)模块,在编码阶段处理并融合多模态数据,向SAM编码器提供更全面的模态信息;2)分层上采样解码器,可在数据有限条件下提取丰富高低层次特征,有效检测小病灶;3)自动生成病灶分割掩码,无需人工提示即可完成全自动分割。

原文摘要 · Abstract (English)

The segmentation of substantial brain lesions is a significant and challenging task in the field of medical image segmentation. Substantial brain lesions in brain imaging exhibit high heterogeneity, with indistinct boundaries between lesion regions and normal brain tissue. Small lesions in single slices are difficult to identify, making the accurate and reproducible segmentation of abnormal regions, as well as their feature description, highly complex. Existing methods have the following limitations: 1) They rely solely on single-modal information for learning, neglecting the multi-modal information commonly used in diagnosis. This hampers the ability to comprehensively acquire brain lesion information from multiple perspectives and prevents the effective integration and utilization of multi-modal data inputs, thereby limiting a holistic understanding of lesions. 2) They are constrained by the amount of data available, leading to low sensitivity to small lesions and difficulty in detecting subtle pathological changes. 3) Current SAM-based models rely on external prompts, which cannot achieve automatic segmentation and, to some extent, affect diagnostic efficiency.To address these issues, we have developed a large-scale fully automated segmentation model specifically designed for brain lesion segmentation, named BrainSegDMLF. This model has the following features: 1) Dynamic Modal Interactive Fusion (DMIF) module that processes and integrates multi-modal data during the encoding process, providing the SAM encoder with more comprehensive modal information. 2) Layer-by-Layer Upsampling Decoder, enabling the model to extract rich low-level and high-level features even with limited data, thereby detecting the presence of small lesions. 3) Automatic segmentation masks, allowing the model to generate lesion masks automatically without requiring manual prompts.

脑病灶分割多模态融合自动分割

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。