提出新评估指标MMCM,更好衡量人类运动预测的多样性与合理性
MMCM: Multimodality-aware Metric using Clustering-based Modes for Probabilistic Human Motion Prediction
- 基于聚类划分运动空间模式,显式检验预测结果是否覆盖多模式
- 通过真实数据构建有效模式库,确保预测运动符合物理合理性
- 适合研究多模态运动生成、评估模型多样性的研究人员
本文提出一种新型人类运动预测评估指标MMCM。由于单一历史序列可能对应多种未来运动,概率化运动预测方法需输出多条可能轨迹。现有评估指标仅关注轨迹分布范围,忽视其是否覆盖多个运动模式及是否具有运动学合理性。为此,本文提出基于聚类的多模态感知评估指标(MMCM)。针对覆盖率,将运动空间划分为多个簇,每个簇视为一个运动模式,检验预测轨迹是否分散于多个模式;针对有效性,从运动数据集中收集真实可能的未来轨迹,定义有效模式。实验表明,所提聚类方法能生成合理模式划分,且MMCM能准确评估多模态预测结果。代码已开源。
原文摘要 · Abstract (English)
This paper proposes a novel metric for Human Motion Prediction (HMP). Since a single past sequence can lead to multiple possible futures, a probabilistic HMP method predicts such multiple motions. While a single motion predicted by a deterministic method is evaluated only with the difference from its ground truth motion, multiple predicted motions should also be evaluated based on their distribution. For this evaluation, this paper focuses on the following two criteria. \textbf{(a) Coverage}: motions should be distributed among multiple motion modes to cover diverse possibilities. \textbf{(b) Validity}: motions should be kinematically valid as future motions observable from a given past motion. However, existing metrics simply appreciate widely distributed motions even if these motions are observed in a single mode and kinematically invalid. To resolve these disadvantages, this paper proposes a Multimodality-aware Metric using Clustering-based Modes (MMCM). For (a) coverage, MMCM divides a motion space into several clusters, each of which is regarded as a mode. These modes are used to explicitly evaluate whether predicted motions are distributed among multiple modes. For (b) validity, MMCM identifies valid modes by collecting possible future motions from a motion dataset. Our experiments validate that our clustering yields sensible mode definitions and that MMCM accurately scores multimodal predictions. Code: https://github.com/placerkyo/MMCM
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。