检测两人协作中的异常行为,提升动作识别准确率。
3D Human-Human Interaction Anomaly Detection
- 共享双人运动嵌入,捕捉协作动态相关性。
- 引入距离关系编码模块,建模空间社交线索。
- 适用于多人交互场景的异常检测,适合智能监控应用。
以人类为中心的异常检测主要针对单人行为,但人类天然以协作方式行动,异常也可能源于人与人之间的互动。现有单人异常检测模型在处理此类问题时准确率较低,因其难以捕捉交互中的复杂非对称动态。本文提出新任务:人-人交互异常检测(H2IAD),旨在识别协作3D人体动作中的异常交互行为。为此,提出交互异常检测网络(IADNet),采用时间注意力共享模块(TASM),通过跨两人共享编码运动嵌入,有效同步协作运动相关性。此外,注意到交互还具有空间配置特征,引入基于距离的关系编码模块(DREM)以更好反映社交线索。最终使用归一化流进行异常打分。在多人运动基准数据集上的大量实验表明,IADNet在H2IAD任务上优于现有以人类为中心的异常检测基线。
原文摘要 · Abstract (English)
Human-centric anomaly detection (AD) has been primarily studied to specify anomalous behaviors in a single person. However, as humans by nature tend to act in a collaborative manner, behavioral anomalies can also arise from human-human interactions. Detecting such anomalies using existing single-person AD models is prone to low accuracy, as these approaches are typically not designed to capture the complex and asymmetric dynamics of interactions. In this paper, we introduce a novel task, Human-Human Interaction Anomaly Detection (H2IAD), which aims to identify anomalous interactive behaviors within collaborative 3D human actions. To address H2IAD, we then propose Interaction Anomaly Detection Network (IADNet), which is formalized with a Temporal Attention Sharing Module (TASM). Specifically, in designing TASM, we share the encoded motion embeddings across both people such that collaborative motion correlations can be effectively synchronized. Moreover, we notice that in addition to temporal dynamics, human interactions are also characterized by spatial configurations between two people. We thus introduce a Distance-Based Relational Encoding Module (DREM) to better reflect social cues in H2IAD. The normalizing flow is eventually employed for anomaly scoring. Extensive experiments on human-human motion benchmarks demonstrate that IADNet outperforms existing Human-centric AD baselines in H2IAD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。