用图神经网络直接定位脑肿瘤,无需复杂解码器。
Decoder-Free Supervoxel GNN for Accurate Brain-Tumor Localization in Multi-Modal MRI
- 将3D MRI分成语义超体素,构建图结构进行特征学习。
- 分类任务F1达0.875,回归任务平均误差仅0.028。
- 适合需要可解释性的医学图像分析场景。
当前3D医学图像视觉骨干网络多采用参数密集的编码器-解码器结构,大量参数用于空间重建而非特征学习。本文提出SVGFormer,一种无解码器的框架,通过内容感知分组将体积划分为语义超体素图。其分层编码器结合补丁级Transformer与超体素级图注意力网络,联合建模细粒度区域内部特征与大范围区域间依赖关系。该设计将全部可学习能力集中于特征编码,提供从补丁到区域的双重可解释性。为验证框架灵活性,在BraTS数据集上训练了两个专用模型:一个用于节点级分类,另一个用于肿瘤占比回归。两者均表现优异,分类模型F1-score达0.875,回归模型MAE为0.028,证实编码器具备学习判别性与局部化特征的能力。结果表明,基于图的纯编码器范式为3D医学图像表征提供了准确且内在可解释的替代方案。
原文摘要 · Abstract (English)
Modern vision backbones for 3D medical imaging typically process dense voxel grids through parameter-heavy encoder-decoder structures, a design that allocates a significant portion of its parameters to spatial reconstruction rather than feature learning. Our approach introduces SVGFormer, a decoder-free pipeline built upon a content-aware grouping stage that partitions the volume into a semantic graph of supervoxels. Its hierarchical encoder learns rich node representations by combining a patch-level Transformer with a supervoxel-level Graph Attention Network, jointly modeling fine-grained intra-region features and broader inter-regional dependencies. This design concentrates all learnable capacity on feature encoding and provides inherent, dual-scale explainability from the patch to the region level. To validate the framework's flexibility, we trained two specialized models on the BraTS dataset: one for node-level classification and one for tumor proportion regression. Both models achieved strong performance, with the classification model achieving a F1-score of 0.875 and the regression model a MAE of 0.028, confirming the encoder's ability to learn discriminative and localized features. Our results establish that a graph-based, encoder-only paradigm offers an accurate and inherently interpretable alternative for 3D medical image representation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。