用频域动态变化提升隐蔽物体检测,效率更高精度更优。
Mamba-based Spatio-Frequency Motion Perception for Video Camouflaged Object Detection
- 结合空间与频域特征,通过频谱扫描建模运动
- 在两个数据集上6项指标超越现有方法,计算量更低
- 适合需要高效高精度视频隐蔽目标检测的场景
现有视频隐蔽物体检测(VCOD)方法主要依赖空间外观进行运动感知,但因前景与背景相似度高,导致颜色、纹理等外观特征区分度低。近期研究发现,频域特征不仅能弥补外观局限,还可通过频谱能量的动态变化感知运动。本文提出Vcamba,一种基于Mamba的时空-频域运动感知模型,融合空间与频率特征实现高效准确的VCOD。通过分析频域成分的空间表征,揭示了成分有序叠加产生的结构演化规律,并提出频域序列扫描(FSS)策略以展开频谱。利用FSS,自适应频域增强(AFE)模块采用Mamba建模序列中的因果依赖,实现有效频域学习。此外,设计了基于空间的长程运动感知(SLMP)和基于频域的长程运动感知(FLMP)模块,分别建模时空与频时序列。最后,空间与频域运动融合模块(SFMF)将双域特征整合为统一运动表示。实验表明,Vcamba在2个数据集上6项评估指标均优于现有方法,且计算成本更低。代码已开源:https://github.com/BoydeLi/Vcamba。
原文摘要 · Abstract (English)
Existing video camouflaged object detection (VCOD) methods primarily rely on spatial appearances for motion perception. However, the high foreground-background similarity in VCOD limits the discriminability of such features (e.g. color and texture). Recent studies demonstrate that frequency features can not only compensate for appearance limitations, but also perceive motion through dynamic variations in spectral energy. Meanwhile, the emerging state space model called Mamba enables efficient motion perception in frame sequences with its linear-time long-sequence modeling capability. Motivated by this, we propose Vcamba, a visual camouflage Mamba based on spatio-frequency motion perception that integrates frequency and spatial features for efficient and accurate VCOD. Specifically, by analyzing the spatial representations of frequency components, we reveal a structural evolution pattern that emerges from the ordered superposition of components. Based on this observation, we propose a unique frequency-domain sequential scanning (FSS) strategy to unfold the spectrum. Utilizing FSS, the adaptive frequency enhancement (AFE) module employs Mamba to model the causal dependencies within sequences, enabling effective frequency learning. Furthermore, we propose a space-based long-range motion perception (SLMP) module and a frequency-based long-range motion perception (FLMP) module to model spatio-temporal and frequency-temporal sequences. Finally, the space and frequency motion fusion module (SFMF) integrates dual-domain features into unified motion representation. Experiments show that Vcamba outperforms state-of-the-art methods across 6 evaluation metrics on 2 datasets with lower computation cost, confirming its superiority. Code is available at: https://github.com/BoydeLi/Vcamba.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。