arXiv:2511.09605eess.IVcs.AI2025-11被引 1

用球面切片+图网络提升医学3D图像分类精度

TomoGraphView: 3D Medical Image Classification with Omnidirectional Slice Representations and Graph Neural Networks

  • 从球面采样多角度切片,突破传统平面切片局限
  • 通过图神经网络融合切片特征,保留3D空间结构
  • 适合肿瘤等不规则病灶的3D影像分析任务

医学断层扫描数量激增,亟需自动化系统提取有效特征用于肿瘤表征等下游任务。尽管3D体数据信息更丰富,但其复杂的空间依赖性及大规模3D数据集稀缺,限制了3D基础模型的发展。当前多数方法依赖自然图像训练的2D视觉基础模型,通过切片分解应用于医学扫描,虽表现良好,但仍存在根本局限:标准轴向、矢状、冠状切片难以捕捉非对齐结构的真实空间范围,且多数方法独立聚合切片特征,忽略3D几何关系,丢失空间一致性。为此,我们提出TomoGraphView,结合全方位体积切片与球形图神经网络特征聚合。该方法在包围体的球面上均匀采样生成标准与非标准切片,公开代码库见http://github.com/compai-lab/2025-MedIA-kiechle,提供易用的全方位切片工具包OmniSlicer(https://pypi.org/project/OmniSlicer)。

原文摘要 · Abstract (English)

The sharp rise in medical tomography examinations has created a demand for automated systems that can reliably extract informative features for downstream tasks such as tumor characterization. Although 3D volumes contain richer information than individual slices, effective 3D classification remains difficult: volumetric data encode complex spatial dependencies, and the scarcity of large-scale 3D datasets has constrained progress toward 3D foundation models. As a result, many recent approaches rely on 2D vision foundation models trained on natural images, repurposing them as feature extractors for medical scans with surprisingly strong performance. Despite their practical success, current methods that apply 2D foundation models to 3D scans via slice-based decomposition remain fundamentally limited. Standard slicing along axial, sagittal, and coronal planes often fails to capture the true spatial extent of a structure when its orientation does not align with these canonical views. More critically, most approaches aggregate slice features independently, ignoring the underlying 3D geometry and losing spatial coherence across slices. To overcome these limitations, we propose TomoGraphView, a novel framework that integrates omnidirectional volume slicing with spherical graph-based feature aggregation. Instead of restricting the model to axial, sagittal, or coronal planes, our method samples both canonical and non-canonical cross-sections generated from uniformly distributed points on a sphere enclosing the volume. We publicly share our accessible code base at http://github.com/compai-lab/2025-MedIA-kiechle and provide a user-friendly library for omnidirectional volume slicing at https://pypi.org/project/OmniSlicer.

3D医学图像图神经网络切片策略

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。