针对无人机动态背景视频异常检测,提出新型时序建模方法
FTDMamba: Frequency-Assisted Temporal Dilation Mamba for Unmanned Aerial Vehicle Video Anomaly Detection
- 通过频域解耦分离物体与无人机自身运动,建模全局时空依赖
- 结合时序膨胀与Mamba结构,在多尺度下联合学习时序与空间特征
- 构建首个大规模动态背景无人机异常检测数据集,适配真实飞行场景
现有视频异常检测方法多聚焦于地面监控或静态背景无人机视频,而对动态背景下的无人机视频研究不足。动态拍摄的无人机视频存在多源运动耦合问题,物体运动与无人机自身引起的全局运动交织难分,导致现有方法易将正常飞行误判为异常,或漏检隐藏在动态背景中的真实异常。同时,多数方法未能有效建模帧间连续性与跨时间尺度的局部空间相关性。为此,本文提出频率辅助时序膨胀Mamba网络(FTDMamba),包含两个核心模块:(1) 频率解耦时空相关模块,通过频域分析解耦耦合运动模式,建模全局时空依赖;(2) 时序膨胀Mamba模块,利用Mamba序列建模能力,联合学习多尺度下的细粒度时序动态与局部空间结构。此外,构建大规模动态背景无人机异常检测数据集MUVAD,包含222,736帧和240个异常事件,涵盖12类异常。大量实验表明,FTDMamba在两个公开静态基准及新构建的MUVAD数据集上均达到当前最优性能。代码与数据集已开源。
原文摘要 · Abstract (English)
Recent advances in video anomaly detection (VAD) mainly focus on ground-based surveillance or unmanned aerial vehicle (UAV) videos with static backgrounds, whereas research on UAV videos with dynamic backgrounds remains limited. Unlike static scenarios, dynamically captured UAV videos exhibit multi-source motion coupling, where the motion of objects and UAV-induced global motion are intricately intertwined. Consequently, existing methods may misclassify normal UAV movements as anomalies or fail to capture true anomalies concealed within dynamic backgrounds. Moreover, many approaches do not adequately address the joint modeling of inter-frame continuity and local spatial correlations across diverse temporal scales. To overcome these limitations, we propose the Frequency-Assisted Temporal Dilation Mamba (FTDMamba) network for UAV VAD, including two core components: (1) a Frequency Decoupled Spatiotemporal Correlation Module, which disentangles coupled motion patterns and models global spatiotemporal dependencies through frequency analysis; and (2) a Temporal Dilation Mamba Module, which leverages Mamba's sequence modeling capability to jointly learn fine-grained temporal dynamics and local spatial structures across multiple temporal receptive fields. Additionally, unlike existing UAV VAD datasets which focus on static backgrounds, we construct a large-scale Moving UAV VAD dataset (MUVAD), comprising 222,736 frames with 240 anomaly events across 12 anomaly types. Extensive experiments demonstrate that FTDMamba achieves state-of-the-art (SOTA) performance on two public static benchmarks and the new MUVAD dataset. The code and MUVAD dataset will be available at: https://github.com/uavano/FTDMamba.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。