arXiv:2508.08179cs.CVcs.MM2025-08中稿 · ACM Multimedia 202…被引 5

提出物理-感知双维度的人体动作生成评估方法。

PP-Motion: Physical-Perceptual Fidelity Evaluation for Human Motion Generation

  • 基于物理约束最小修改量生成精细连续标注
  • 新指标同时匹配物理规律与人类感知
  • 适合动作生成、虚拟现实等领域的质量评估

人体动作生成在AR/VR、影视、体育和医疗康复等领域广泛应用,为传统动捕系统提供低成本替代。然而,动作保真度评估仍具挑战:现有方法在人类感知与物理可行性之间存在固有差距,且主观二值标注难以支撑数据驱动度量。为此,本文提出一种物理标注方法,通过计算动作满足物理定律所需的最小修改量,生成细粒度、连续的物理对齐标注作为客观真值。基于此,提出PP-Motion,一种新型数据驱动度量,可同时评估物理与感知保真度。为捕捉物理先验,采用皮尔逊相关损失训练;结合人感知损失,使度量兼顾人类判断与物理合理性。实验表明,该指标不仅符合物理规律,且在人类感知一致性上优于已有方法。

原文摘要 · Abstract (English)

Human motion generation has found widespread applications in AR/VR, film, sports, and medical rehabilitation, offering a cost-effective alternative to traditional motion capture systems. However, evaluating the fidelity of such generated motions is a crucial, multifaceted task. Although previous approaches have attempted at motion fidelity evaluation using human perception or physical constraints, there remains an inherent gap between human-perceived fidelity and physical feasibility. Moreover, the subjective and coarse binary labeling of human perception further undermines the development of a robust data-driven metric. We address these issues by introducing a physical labeling method. This method evaluates motion fidelity by calculating the minimum modifications needed for a motion to align with physical laws. With this approach, we are able to produce fine-grained, continuous physical alignment annotations that serve as objective ground truth. With these annotations, we propose PP-Motion, a novel data-driven metric to evaluate both physical and perceptual fidelity of human motion. To effectively capture underlying physical priors, we employ Pearson's correlation loss for the training of our metric. Additionally, by incorporating a human-based perceptual fidelity loss, our metric can capture fidelity that simultaneously considers both human perception and physical alignment. Experimental results demonstrate that our metric, PP-Motion, not only aligns with physical laws but also aligns better with human perception of motion fidelity than previous work.

动作生成保真度评估物理约束

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。