arXiv:2505.04002cs.GRcs.AI2025-05International Conf…被引 38

用强化学习生成并优化虚拟角色攀爬跳跃动作,解决数据不足问题。

PARC: Physics-based Augmentation with Reinforcement Learning for Character Controllers

  • 基于物理仿真和强化学习迭代生成新地形动作数据
  • 通过追踪控制器修正生成动作的接触错误与不连续问题
  • 适合需要复杂地形移动能力的虚拟角色开发

人类在复杂环境中展现出卓越的敏捷运动能力,如跑酷者完成攀墙、跨跃等动态动作。但模拟角色复现此类行为仍具挑战,主要受限于敏捷地形穿越动作的运动捕捉数据稀缺及采集成本高昂。本文提出PARC(Physics-based Augmentation with Reinforcement Learning for Character Controllers)框架,利用机器学习与物理仿真,通过迭代方式扩充动作数据集并提升地形穿越控制器性能。该框架首先在少量核心地形穿越技能数据上训练动作生成器;随后用其生成新地形的合成动作,但这些动作常存在接触错误或不连续等伪影。为此,我们训练一个基于物理的跟踪控制器,在仿真中模仿生成动作以纠正缺陷。修正后的动作被加入数据集,用于下一轮动作生成器训练。此迭代过程协同提升生成器与追踪器能力,构建出具备敏捷性与泛化性的复杂环境交互模型。PARC为开发高机动地形穿越控制器提供有效方案,弥合了动作数据稀缺与多功能角色控制器需求之间的差距。

原文摘要 · Abstract (English)

Humans excel in navigating diverse, complex environments with agile motor skills, exemplified by parkour practitioners performing dynamic maneuvers, such as climbing up walls and jumping across gaps. Reproducing these agile movements with simulated characters remains challenging, in part due to the scarcity of motion capture data for agile terrain traversal behaviors and the high cost of acquiring such data. In this work, we introduce PARC (Physics-based Augmentation with Reinforcement Learning for Character Controllers), a framework that leverages machine learning and physics-based simulation to iteratively augment motion datasets and expand the capabilities of terrain traversal controllers. PARC begins by training a motion generator on a small dataset consisting of core terrain traversal skills. The motion generator is then used to produce synthetic data for traversing new terrains. However, these generated motions often exhibit artifacts, such as incorrect contacts or discontinuities. To correct these artifacts, we train a physics-based tracking controller to imitate the motions in simulation. The corrected motions are then added to the dataset, which is used to continue training the motion generator in the next iteration. PARC's iterative process jointly expands the capabilities of the motion generator and tracker, creating agile and versatile models for interacting with complex environments. PARC provides an effective approach to develop controllers for agile terrain traversal, which bridges the gap between the scarcity of motion data and the need for versatile character controllers.

动作生成强化学习物理仿真

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。