arXiv:2602.01593cs.CV2026-02

用Mamba架构实现通用高精度显著性目标检测,支持多模态输入。

Samba+: General and Accurate Salient Object Detection via A More Unified Mamba-based Framework

  • 基于Mamba设计新型扫描机制,保留显著区域空间连续性。
  • 在22个数据集上6项任务均超越现有方法,计算成本更低。
  • 支持多模态融合与持续学习,适合复杂场景应用。

现有显著性目标检测(SOD)模型受限于卷积网络感受野有限及Transformer计算复杂度高。新兴状态空间模型Mamba在全局感受野与计算效率间展现潜力。为此,我们提出纯Mamba架构的Saliency Mamba(Samba),可灵活处理包括RGB/RGB-D/RGB-T、视频SOD(VSOD)、RGB-D VSOD及可见-深度-热成像SOD在内的六类任务。针对SOD特性,重新设计Mamba扫描策略,引入聚焦显著性的空间邻域扫描(SNS)算法以保持显著区域空间连续性;提出上下文感知上采样(CAU)方法,建模上下文依赖关系促进层级特征对齐与聚合。为进一步突破任务专用限制,构建多任务联合训练的Samba+,采用中心辐射图注意力(HGA)模块实现跨模态自适应融合,并引入模态锚定持续学习(MACL)策略缓解模态冲突与灾难性遗忘。大量实验表明,单个Samba模型在22个数据集上六项任务均优于现有方法,且计算开销更低;而Samba+则以单一模型实现更优性能,展现强大泛化能力。

原文摘要 · Abstract (English)

Existing salient object detection (SOD) models are generally constrained by the limited receptive fields of convolutional neural networks (CNNs) and quadratic computational complexity of Transformers. Recently, the emerging state-space model, namely Mamba, has shown great potential in balancing global receptive fields and computational efficiency. As a solution, we propose Saliency Mamba (Samba), a pure Mamba-based architecture that flexibly handles various distinct SOD tasks, including RGB/RGB-D/RGB-T SOD, video SOD (VSOD), RGB-D VSOD, and visible-depth-thermal SOD. Specifically, we rethink the scanning strategy of Mamba for SOD, and introduce a saliency-guided Mamba block (SGMB) that features a spatial neighborhood scanning (SNS) algorithm to preserve the spatial continuity of salient regions. A context-aware upsampling (CAU) method is also proposed to promote hierarchical feature alignment and aggregation by modeling contextual dependencies. As one step further, to avoid the "task-specific" problem as in previous SOD solutions, we develop Samba+, which is empowered by training Samba in a multi-task joint manner, leading to a more unified and versatile model. Two crucial components that collaboratively tackle challenges encountered in input of arbitrary modalities and continual adaptation are investigated. Specifically, a hub-and-spoke graph attention (HGA) module facilitates adaptive cross-modal interactive fusion, and a modality-anchored continual learning (MACL) strategy alleviates inter-modal conflicts together with catastrophic forgetting. Extensive experiments demonstrate that Samba individually outperforms existing methods across six SOD tasks on 22 datasets with lower computational cost, whereas Samba+ achieves even superior results on these tasks and datasets by using a single trained versatile model. Additional results further demonstrate the potential of our Samba framework.

显著性检测Mamba多模态持续学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。