arXiv:2409.05387cs.CVcs.GR2024-09SIGGRAPH被引 10

通过髋部速度解耦控制接触,实现更自然的运动风格迁移。

Decoupling Contact for Fine-Grained Motion Style Transfer

  • 用髋部速度间接控制接触,分离轨迹与接触时机
  • 在多个数据集上提升风格表现力与运动自然度
  • 适合动画、游戏中的精细动作风格控制

运动风格迁移可在保留动作内容的同时改变其风格,广泛应用于计算机动画与游戏。接触是影响风格表达与运动自然性的关键因素,但如何细粒度解耦并控制接触仍不明确。本文提出一种新方法,通过经验发现将接触控制间接建模为髋部速度,并进一步分解为轨迹与接触时机。为此,我们构建一个新模型,显式建模动作、轨迹、接触时机与风格之间的关联,实现独立解耦控制。方法基于运动流形设计,髋部控制可轻松融入基于Transformer的解码器中,具备灵活性——既可直接生成动作,也可作为后处理提升现有方法的质量与接触可控性。此外,我们提出一种新度量指标,基于经验建立的运动相关模式,与人类感知高度一致。大量实验表明,该方法在风格表现力与运动质量上均优于现有方法。

原文摘要 · Abstract (English)

Motion style transfer changes the style of a motion while retaining its content and is useful in computer animations and games. Contact is an essential component of motion style transfer that should be controlled explicitly in order to express the style vividly while enhancing motion naturalness and quality. However, it is unknown how to decouple and control contact to achieve fine-grained control in motion style transfer. In this paper, we present a novel style transfer method for fine-grained control over contacts while achieving both motion naturalness and spatial-temporal variations of style. Based on our empirical evidence, we propose controlling contact indirectly through the hip velocity, which can be further decomposed into the trajectory and contact timing, respectively. To this end, we propose a new model that explicitly models the correlations between motions and trajectory/contact timing/style, allowing us to decouple and control each separately. Our approach is built around a motion manifold, where hip controls can be easily integrated into a Transformer-based decoder. It is versatile in that it can generate motions directly as well as be used as post-processing for existing methods to improve quality and contact controllability. In addition, we propose a new metric that measures a correlation pattern of motions based on our empirical evidence, aligning well with human perception in terms of motion naturalness. Based on extensive evaluation, our method outperforms existing methods in terms of style expressivity and motion quality.

运动迁移风格控制接触建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。