提出无需训练的vSTMD模型,实现高速度下极小目标的实时运动检测。
vSTMD: Visual Motion Detection for Extremely Tiny Target at Various Velocities
- 基于昆虫视觉机制设计自适应动态电位模型,覆盖广速度范围
- 提出协同方向梯度计算策略,计算量仅为原方法1/8且精度更高
- 在真实数据集上比顶尖方法快60倍,适合复杂背景实时应用
极小目标(ET-)的视觉运动检测因类别无关性与视觉线索稀缺而极具挑战,主流基于特征的方法常失效。受昆虫视觉小目标运动检测(STMD)通路启发,自然架构展现出潜力。但现有STMD模型仅适用于窄速度范围,难以应对真实场景中目标多变且不稳定的运动特性。为此,本文提出vSTMD——一种无需训练的极小目标多速度运动检测模型。核心创新包括:(1) 跨抑制动态电位(cIDP)机制,可自适应捕捉宽速度范围内的运动线索;(2) 首个协同方向梯度计算(CDGC)策略,在降低计算开销至原有孤立方案1/8的同时提升方向估计精度与鲁棒性。在真实世界数据集RIST上的评估显示,vSTMD及其反馈增强版本vSTMD-F相比最先进的STMD方法分别获得30%和58%的相对F₁提升。此外,两者在方向估计性能上媲美最先进深度学习方法。实验还表明,该自然架构在效率上显著优于当前数据驱动方法:vSTMD快60倍,极适合动态场景与复杂背景下的实时应用。代码已开源于https://github.com/MingshuoXu/vSTMD。
原文摘要 · Abstract (English)
Visual motion detection for extremely tiny (ET-) targets is challenging, due to their category-independent nature and the scarcity of visual cues, which often incapacitate mainstream feature-based models. Natural architectures with rich interpretability offer a promising alternative, where STMD architectures derived from insect visual STMD (Small Target Motion Detector) pathways have demonstrated their effectiveness. However, previous STMD models are constrained to a narrow velocity range, hindering their efficacy in real-world scenarios where targets exhibit diverse and unstable dynamics. To address this limitation, we present vSTMD, a learning-free model for motion detection of ET-targets at various velocities. Our key innovations include: (1) a cross-Inhibition Dynamic Potential (cIDP) that serves as a self-adaptive mechanism efficiently capturing motion cues across a wide velocity spectrum, and (2) the first Collaborative Directional Gradient Calculation (CDGC) strategy, which enhances orienting accuracy and robustness while reducing computational overhead to one-eighth of previously isolated strategies. Evaluated on the real-world dataset RIST, the proposed vSTMD and its feedback-facilitated variant vSTMD-F achieve relative $F_{1}$ gains of $30\%$ and $58\%$ over state-of-the-art (SOTA) STMD approaches, respectively. Furthermore, both models demonstrate competitive orientation estimation performance compared to SOTA deep learning-driven methods. Experiments also reveal the superiority of the natural architecture for ET-object motion detection - vSTMD is $60\times$ faster than contemporary data-driven methods, making it highly suitable for real-time applications in dynamic scenarios and complex backgrounds. Code is available at https://github.com/MingshuoXu/vSTMD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。