arXiv:2505.10672eess.IVcs.CV2025-05被引 3

用多视角注意力筛选关键切片,提升腹部CT器官分割效率与精度

MOSAIC: A Multi-View 2.5D Organ Slice Selector with Cross-Attentional Reasoning for Anatomically-Aware CT Localization in Medical Organ Segmentation

  • 基于三视图融合的2.5D表示,通过视觉语言模型检测器官存在
  • 在多个器官上实现比基线更高的切片定位一致性,平均提升显著
  • 提出新指标SLC评估切片空间对齐性,适用于各类定位方法

从腹部CT体积中高效准确地进行多器官分割是医学图像分析中的基础挑战。现有3D分割方法计算和内存开销大,常处理大量解剖无关切片;而2D方法存在类别不平衡且缺乏跨视角上下文感知。为此,我们提出一种新型解剖感知切片选择管道,在分割前减少输入体积。统一框架引入视觉语言模型(VLM),利用轴向、矢状面和冠状面的三视图融合(2.5D)表示进行跨视角器官存在检测。所提模型作为解剖定位专家,通过多视角表示推理,仅保留具有高结构相关性的切片,实现各方向的空间一致过滤并保留上下文线索。更重要的是,由于标准分割指标(如Dice或IoU)无法衡量此类切片选择的空间精度,我们提出新指标切片定位一致性(SLC),联合捕捉解剖覆盖率与以器官为中心参考切片的空间对齐性。不同于分割专用指标,SLC提供模型无关的定位保真度评估。我们的模型在所有器官上均优于多个基线,展示出精准可靠的器官聚焦切片过滤能力。结果表明,该方法可显著降低下游分割成本,同时保持高解剖保真度。

原文摘要 · Abstract (English)

Efficient and accurate multi-organ segmentation from abdominal CT volumes is a fundamental challenge in medical image analysis. Existing 3D segmentation approaches are computationally and memory intensive, often processing entire volumes that contain many anatomically irrelevant slices. Meanwhile, 2D methods suffer from class imbalance and lack cross-view contextual awareness. To address these limitations, we propose a novel, anatomically-aware slice selector pipeline that reduces input volume prior to segmentation. Our unified framework introduces a vision-language model (VLM) for cross-view organ presence detection using fused tri-slice (2.5D) representations from axial, sagittal, and coronal planes. Our proposed model acts as an "expert" in anatomical localization, reasoning over multi-view representations to selectively retain slices with high structural relevance. This enables spatially consistent filtering across orientations while preserving contextual cues. More importantly, since standard segmentation metrics such as Dice or IoU fail to measure the spatial precision of such slice selection, we introduce a novel metric, Slice Localization Concordance (SLC), which jointly captures anatomical coverage and spatial alignment with organ-centric reference slices. Unlike segmentation-specific metrics, SLC provides a model-agnostic evaluation of localization fidelity. Our model offers substantial improvement gains against several baselines across all organs, demonstrating both accurate and reliable organ-focused slice filtering. These results show that our method enables efficient and spatially consistent organ filtering, thereby significantly reducing downstream segmentation cost while maintaining high anatomical fidelity.

器官分割切片筛选多视角2.5D

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。