区分人体内部与群体间关系,提升多人运动预测精度
Relation Learning and Aggregate-attention for Multi-person Motion Prediction
- 分离建模个体关节关系与群体交互关系,避免冗余依赖
- 在多个数据集上达到当前最优性能,最高达9.8%误差降低
- 模块可通用,适合需精准交互建模的多人行为分析场景
多人运动预测是一项具有广泛应用前景的复杂任务。与单人预测不同,它不仅关注骨骼结构或轨迹,还需建模人与人之间的交互关系。现有方法虽表现优异,但常忽略个体内部关系(intra-relation)与群体间关系(inter-relation)的本质差异,缺乏对两类关系的显式建模,导致引入不必要的依赖。为此,本文提出一种协同框架:基于GCN的网络建模intra-relations,设计新型推理网络建模inter-relations;并引入即插即用的交互聚合模块(IAM),采用聚合注意力机制融合两类关系。实验表明,该模块可适配其他双路径模型。在3DPW、3DPW-RC、CMU-Mocap、MuPoTS-3D及合成数据集Mix1&Mix2(含9至15人)上的大量实验验证了方法的优越性,性能达到当前最佳。
原文摘要 · Abstract (English)
Multi-person motion prediction is an emerging and intricate task with broad real-world applications. Unlike single person motion prediction, it considers not just the skeleton structures or human trajectories but also the interactions between others. Previous methods use various networks to achieve impressive predictions but often overlook that the joints relations within an individual (intra-relation) and interactions among groups (inter-relation) are distinct types of representations. These methods often lack explicit representation of inter&intra-relations, and inevitably introduce undesired dependencies. To address this issue, we introduce a new collaborative framework for multi-person motion prediction that explicitly modeling these relations:a GCN-based network for intra-relations and a novel reasoning network for inter-relations.Moreover, we propose a novel plug-and-play aggregation module called the Interaction Aggregation Module (IAM), which employs an aggregate-attention mechanism to seamlessly integrate these relations. Experiments indicate that the module can also be applied to other dual-path models. Extensive experiments on the 3DPW, 3DPW-RC, CMU-Mocap, MuPoTS-3D, as well as synthesized datasets Mix1 & Mix2 (9 to 15 persons), demonstrate that our method achieves state-of-the-art performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。