arXiv:2502.20784eess.IVcs.CV2025-02被引 6

用自回归预测下一尺度掩码,提升复杂解剖结构分割精度

Autoregressive Medical Image Segmentation via Next-Scale Mask Prediction

  • 通过自回归机制建模跨尺度依赖关系,逐级预测更高分辨率掩码
  • 在两个不同模态的基准数据集上,分割性能优于现有方法
  • 适合需要高精度、可解释性医学图像分割的研究者使用

尽管深度学习显著推动了医学图像分割的发展,但现有方法在处理复杂解剖区域时仍存在困难。级联或深度监督方法虽尝试通过多尺度特征学习解决此问题,却未能建立充分的跨尺度依赖,因每一尺度仅依赖前一尺度特征。为此,本文提出基于下一尺度掩码预测的自回归分割框架AR-Seg,通过统一架构显式建模所有先前尺度间的依赖关系,逐步预测下一尺度掩码。AR-Seg引入三项创新:(1) 多尺度掩码自编码器,将掩码量化为多尺度标记图以捕捉层次化解剖结构;(2) 下一尺度自回归机制,逐步预测下一尺度掩码以实现充分的跨尺度依赖;(3) 共识聚合策略,融合多次采样结果生成更精确掩码,进一步提升分割鲁棒性。在两个具有不同模态的基准数据集上的大量实验表明,AR-Seg在分割性能上超越当前最优方法,同时明确可视化从粗到细的中间分割过程。

原文摘要 · Abstract (English)

While deep learning has significantly advanced medical image segmentation, most existing methods still struggle with handling complex anatomical regions. Cascaded or deep supervision-based approaches attempt to address this challenge through multi-scale feature learning but fail to establish sufficient inter-scale dependencies, as each scale relies solely on the features of the immediate predecessor. To this end, we propose the AutoRegressive Segmentation framework via next-scale mask prediction, termed AR-Seg, which progressively predicts the next-scale mask by explicitly modeling dependencies across all previous scales within a unified architecture. AR-Seg introduces three innovations: (1) a multi-scale mask autoencoder that quantizes the mask into multi-scale token maps to capture hierarchical anatomical structures, (2) a next-scale autoregressive mechanism that progressively predicts next-scale masks to enable sufficient inter-scale dependencies, and (3) a consensus-aggregation strategy that combines multiple sampled results to generate a more accurate mask, further improving segmentation robustness. Extensive experimental results on two benchmark datasets with different modalities demonstrate that AR-Seg outperforms state-of-the-art methods while explicitly visualizing the intermediate coarse-to-fine segmentation process.

医学图像分割自回归多尺度掩码预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。