arXiv:2501.18783cs.CV2025-01ICML被引 58

提出可逆展开网络,同时在掩码和图像域提升隐蔽物体分割精度。

RUN: Reversible Unfolding Network for Concealed Object Segmentation

  • 通过多阶段可逆模块,联合优化掩码与图像域的分割结果。
  • 在多个数据集上达到领先性能,显著减少误检与漏检。
  • 适合需要高精度分割的安防、医学影像等场景。

现有隐蔽物体分割(COS)方法多采用可逆策略处理不确定区域,但通常仅限于掩码域,未充分挖掘图像域潜力。为此,本文提出可逆展开网络(RUN),基于理论框架在掩码与RGB域同时应用可逆策略,实现精准分割。首先引入额外残差稀疏性约束,构建新型COS模型;再将迭代优化步骤展开为多阶段网络,每阶段包含两个可逆模块:面向分割的前景分离(SOFS)模块在掩码域使用可逆状态空间捕捉非局部信息;面向重建的背景提取(ROBE)模块拓展至RGB域,利用重建网络解决因独立估计产生的前景与背景冲突区域。随着阶段推进,网络逐步在掩码与图像域实现可逆建模,聚焦不确定区域,有效抑制误报与漏报。大量实验表明RUN性能优越,验证了展开式框架在COS及其他高层视觉任务中的潜力。代码与模型将公开。

原文摘要 · Abstract (English)

Existing concealed object segmentation (COS) methods frequently utilize reversible strategies to address uncertain regions. However, these approaches are typically restricted to the mask domain, leaving the potential of the RGB domain underexplored. To address this, we propose the Reversible Unfolding Network (RUN), which applies reversible strategies across both mask and RGB domains through a theoretically grounded framework, enabling accurate segmentation. RUN first formulates a novel COS model by incorporating an extra residual sparsity constraint to minimize segmentation uncertainties. The iterative optimization steps of the proposed model are then unfolded into a multistage network, with each step corresponding to a stage. Each stage of RUN consists of two reversible modules: the Segmentation-Oriented Foreground Separation (SOFS) module and the Reconstruction-Oriented Background Extraction (ROBE) module. SOFS applies the reversible strategy at the mask level and introduces Reversible State Space to capture non-local information. ROBE extends this to the RGB domain, employing a reconstruction network to address conflicting foreground and background regions identified as distortion-prone areas, which arise from their separate estimation by independent modules. As the stages progress, RUN gradually facilitates reversible modeling of foreground and background in both the mask and RGB domains, directing the network's attention to uncertain regions and mitigating false-positive and false-negative results. Extensive experiments demonstrate the superior performance of RUN and highlight the potential of unfolding-based frameworks for COS and other high-level vision tasks. We will release the code and models.

图像分割可逆网络隐蔽物体多域优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。