arXiv:2506.18679cs.CV2025-06被引 5

用多智能体强化学习优化医学图像轮廓,提升分割精度与结构一致性。

MARL-MambaContour: Unleashing Multi-Agent Deep Reinforcement Learning for Active Contour Optimization in Medical Image Segmentation

  • 将轮廓点建模为智能体,通过协作迭代定位边界
  • 在5个数据集上达到最新水平,有效处理模糊边缘和复杂形态
  • 结合Mamba网络实现长程信息交互,适合临床高精度分割场景

我们提出MARL-MambaContour,首个基于多智能体强化学习(MARL)的轮廓式医学图像分割框架。该方法将分割任务重构为聚焦生成拓扑一致的物体级轮廓的多智能体协作问题,克服传统像素级方法缺乏拓扑约束与整体结构感知的缺陷。每个轮廓点被视为独立智能体,通过迭代调整位置以精确对齐目标边界,适应医学图像中常见的模糊边缘与复杂形态。该过程由专用于轮廓的软演员-评论家(SAC)算法优化,并引入熵正则化调节机制(ERAM),动态平衡智能体探索与轮廓平滑性。此外,框架采用基于Mamba的策略网络,包含创新的双向交叉注意力隐藏状态融合机制(BCHFM),缓解状态空间模型在长程建模中的记忆混淆问题,促进更准确的智能体间信息交换与决策。在五个不同医学影像数据集上的大量实验表明,MARL-MambaContour性能达当前最优水平,展现出在临床应用中的高精度与鲁棒性潜力。

原文摘要 · Abstract (English)

We introduce MARL-MambaContour, the first contour-based medical image segmentation framework based on Multi-Agent Reinforcement Learning (MARL). Our approach reframes segmentation as a multi-agent cooperation task focused on generate topologically consistent object-level contours, addressing the limitations of traditional pixel-based methods which could lack topological constraints and holistic structural awareness of anatomical regions. Each contour point is modeled as an autonomous agent that iteratively adjusts its position to align precisely with the target boundary, enabling adaptation to blurred edges and intricate morphologies common in medical images. This iterative adjustment process is optimized by a contour-specific Soft Actor-Critic (SAC) algorithm, further enhanced with the Entropy Regularization Adjustment Mechanism (ERAM) which dynamically balance agent exploration with contour smoothness. Furthermore, the framework incorporates a Mamba-based policy network featuring a novel Bidirectional Cross-attention Hidden-state Fusion Mechanism (BCHFM). This mechanism mitigates potential memory confusion limitations associated with long-range modeling in state space models, thereby facilitating more accurate inter-agent information exchange and informed decision-making. Extensive experiments on five diverse medical imaging datasets demonstrate the state-of-the-art performance of MARL-MambaContour, highlighting its potential as an accurate and robust clinical application.

医学图像分割多智能体强化学习轮廓优化Mamba

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。