arXiv:2410.03987cs.CV2024-10IJCV被引 35

用新型马尔可夫胶囊路由提升伪装目标检测精度与效率

Mamba Capsule Routing Towards Part-Whole Relational Camouflaged Object Detection

  • 在类型级别而非像素级进行胶囊路由,降低计算开销
  • 在三个基准数据集上显著超越现有最优方法
  • 适合需要高效高精度伪装目标检测的研究者

胶囊网络(CapsNets)因其保持分割完整性,在伪装目标检测中表现优异。然而,以往基于期望最大化(EM)的胶囊路由算法因计算量大、参数多而受限,根源在于像素级胶囊路由。本文提出一种新型马尔可夫胶囊路由机制,首先从马尔可夫结构中提取隐含状态作为胶囊向量,生成抽象的类型级胶囊,替代原始的像素级胶囊。这些类型级马尔可夫胶囊输入至EM路由,构建高层胶囊,大幅减少因像素级路由带来的计算与参数负担,从而高效探索部件-整体关系。此外,为恢复像素级特征以支持最终预测,我们利用相邻层类型级马尔可夫胶囊的相关性指导低层像素级胶囊特征的提取。在三个广泛使用的伪装目标检测(COD)基准数据集上的大量实验表明,本方法显著优于现有最先进方法。代码已公开于https://github.com/Liangbo-Cheng/mamba_capsule。

原文摘要 · Abstract (English)

The part-whole relational property endowed by Capsule Networks (CapsNets) has been known successful for camouflaged object detection due to its segmentation integrity. However, the previous Expectation Maximization (EM) capsule routing algorithm with heavy computation and large parameters obstructs this trend. The primary attribution behind lies in the pixel-level capsule routing. Alternatively, in this paper, we propose a novel mamba capsule routing at the type level. Specifically, we first extract the implicit latent state in mamba as capsule vectors, which abstract type-level capsules from pixel-level versions. These type-level mamba capsules are fed into the EM routing algorithm to get the high-layer mamba capsules, which greatly reduce the computation and parameters caused by the pixel-level capsule routing for part-whole relationships exploration. On top of that, to retrieve the pixel-level capsule features for further camouflaged prediction, we achieve this on the basis of the low-layer pixel-level capsules with the guidance of the correlations from adjacent-layer type-level mamba capsules. Extensive experiments on three widely used COD benchmark datasets demonstrate that our method significantly outperforms state-of-the-arts. Code has been available on https://github.com/Liangbo-Cheng/mamba\_capsule.

伪装目标检测胶囊网络马尔可夫模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。