针对缺失影像模态的脑肿瘤分割,提出分层感知融合新方法。
LASSNet: Level-Aware Availability-Conditioned Spatial-Semantic Fusion for Brain Tumor Segmentation with Missing MRI Modalities

- 根据特征层级和模态可用性动态调整跨模态融合策略。
- 在BraTS2019和2023上平均Dice达76.7%和83.2%。
- 适合临床中模态缺失场景,尤其适用于多模态影像不全时。
基于多模态MRI的脑肿瘤分割依赖于四种成像序列的互补信息,但因采集成本、协议差异、扫描失败或患者状况,一种或多种模态可能缺失。现有方法探索了重建、知识迁移和直接特征融合,但未解决缺失模态融合是否应随表示层次变化的问题。高分辨率侧向特征保留空间细节,而压缩瓶颈特征编码语义与跨模态上下文。因此我们假设融合应同时依赖模态可用性和特征层级。提出层级感知可用性条件空间-语义融合网络(LASSNet),包含两个层级专用模块:分层可用性条件融合(HACF)通过可用模态的计数归一化聚合、掩码条件通道调制和局部3D精炼构建四个侧向表征;三尺度关系-空间融合(TriRSF)建模可用模态描述符间关系及多瓶颈分辨率下的空间上下文,经跨尺度聚合与可用性条件全局空间注意力后输出。共享的粗到细解码器从TriRSF语义出发,逐步注入HACF特征,无需重建缺失输入。在所有15种非空模态配置下,LASSNet在BraTS2019和BraTS2023上对整体肿瘤(WT)、增强肿瘤(TC)和肿瘤核心(ET)的平均Dice分别达到76.7%和83.2%。
原文摘要 · Abstract (English)
Brain tumor segmentation from multimodal MRI relies on complementary evidence across four imaging sequences, yet one or more modalities may be unavailable because of acquisition cost, protocol variation, scan failure, or patient condition. Existing work has explored reconstruction, knowledge transfer, and direct feature fusion, but leaves open whether missing-modality fusion should change with representation level. High-resolution lateral features retain spatial detail, whereas compressed bottleneck features encode semantic and inter-modality context. We therefore hypothesize that fusion should be conditioned jointly on modality availability and feature hierarchy. We propose the Level-Aware Availability-Conditioned Spatial-Semantic Fusion Network (LASSNet), which contains two level-specialized modules. Hierarchical Availability-Conditioned Fusion (HACF) constructs four lateral representations using count-normalized aggregation of available modalities, mask-conditioned channel modulation, and local 3D refinement. Tri-Scale Relational-Spatial Fusion (TriRSF) models relations among available modality descriptors and spatial context across multiple bottleneck resolutions, followed by cross-scale aggregation and availability-conditioned global spatial attention. A shared coarse-to-fine decoder starts from TriRSF semantics and progressively injects HACF features, without reconstructing missing inputs. Across all 15 non-empty modality configurations, LASSNet obtains mean Dice scores of 76.7% and 83.2% over WT, TC, and ET on BraTS2019 and BraTS2023, respectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。