用连续建模替代离散分类,更早发现可疑行为变化
SPAN: Continuous Modeling of Suspicion Progression for Temporal Intention Localization
- 将可疑行为建模为连续动态过程,捕捉长期依赖和累积效应
- 在HAI数据集上降低19.8%的均方误差,低频场景提升2.74%准确率
- 适合需要早期预警与可解释性的安防监控系统使用
时间意图定位(TIL)对视频监控至关重要,旨在识别不同等级的可疑意图以提升安全监测能力。现有离散分类方法难以捕捉可疑意图的连续演化特性,限制了早期干预与可解释性。本文提出怀疑进展分析网络(SPAN),从离散分类转向连续回归,有效建模波动且演进的可疑意图。我们发现怀疑具有长期依赖与累积效应,类比于时间点过程(TPP)理论,据此定义了考虑时序特性的怀疑分数公式。引入怀疑系数调制机制,利用多模态信息动态调整可疑行为的影响权重。同时提出概念锚定映射方法,将可疑动作与预定义意图概念关联,揭示行为背后的潜在动机。在HAI数据集上的大量实验表明,SPAN显著优于现有方法:均方误差降低19.8%,平均mAP提升1.78%;尤其在低频场景中实现2.74%的mAP提升,展现出捕捉细微行为变化的优越能力。相比离散分类系统,该连续建模方法可实现更早检测与主动干预,大幅增强系统的可解释性与实际应用价值。
原文摘要 · Abstract (English)
Temporal Intention Localization (TIL) is crucial for video surveillance, focusing on identifying varying levels of suspicious intentions to improve security monitoring. However, existing discrete classification methods fail to capture the continuous nature of suspicious intentions, limiting early intervention and explainability. In this paper, we propose the Suspicion Progression Analysis Network (SPAN), which shifts from discrete classification to continuous regression, enabling the capture of fluctuating and evolving suspicious intentions. We reveal that suspicion exhibits long-term dependencies and cumulative effects, similar to Temporal Point Process (TPP) theory. Based on these insights, we define a suspicion score formula that models continuous changes while accounting for temporal characteristics. We also introduce Suspicion Coefficient Modulation, which adjusts suspicion coefficients using multimodal information to reflect the varying impacts of suspicious actions. Additionally, the Concept-Anchored Mapping method is proposed to link suspicious actions to predefined intention concepts, offering insights into both the actions and their potential underlying intentions. Extensive experiments on the HAI dataset show that SPAN significantly outperforms existing methods, reducing MSE by 19.8% and improving average mAP by 1.78%. Notably, SPAN achieves a 2.74% mAP gain in low-frequency cases, demonstrating its superior ability to capture subtle behavioral changes. Compared to discrete classification systems, our continuous suspicion modeling approach enables earlier detection and proactive intervention, greatly enhancing system explainability and practical utility in security applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。