arXiv:2410.01840cs.ROcs.AI2024-10被引 1

让数字人自然抓取任意物体,从起始位姿到目标姿态全程生成。

Target Pose Guided Whole-body Grasping Motion Generation for Digital Humans

  • 用Transformer网络连接初始与目标姿态,生成全身抓取轨迹。
  • 在GRAB数据集上验证,对随机放置的未知物体有效。
  • 解决脚滑和手穿模问题,适合虚拟角色动画与机器人控制。

抓取操作是人类与日常物品交互的基本方式,其运动合成在动画与机器人等领域需求迫切。现有研究多聚焦于平行夹爪或灵巧手的静态抓取姿态生成,而针对完整手臂乃至类人智能体的全身抓取运动生成仍待探索。本文提出一种面向数字人的抓取运动生成框架,该数字人是虚拟世界中高自由度的人体仿生智能体。给定3D空间中已知的物体初始位姿,首先基于现成的目标抓取姿态生成方法生成全身数字人的目标姿态。随后,以初始姿态与生成的目标姿态为输入,采用基于Transformer的神经网络生成从初始到目标的连续抓取轨迹,实现平滑自然的运动衔接。此外,设计两个后处理优化模块,分别缓解足部滑移与手物穿透问题。在GRAB数据集上进行实验,验证了该方法对随机放置未知物体的全身抓取运动生成的有效性。

原文摘要 · Abstract (English)

Grasping manipulation is a fundamental mode for human interaction with daily life objects. The synthesis of grasping motion is also greatly demanded in many applications such as animation and robotics. In objects grasping research field, most works focus on generating the last static grasping pose with a parallel gripper or dexterous hand. Grasping motion generation for the full arm especially for the full humanlike intelligent agent is still under-explored. In this work, we propose a grasping motion generation framework for digital human which is an anthropomorphic intelligent agent with high degrees of freedom in virtual world. Given an object known initial pose in 3D space, we first generate a target pose for whole-body digital human based on off-the-shelf target grasping pose generation methods. With an initial pose and this generated target pose, a transformer-based neural network is used to generate the whole grasping trajectory, which connects initial pose and target pose smoothly and naturally. Additionally, two post optimization components are designed to mitigates foot-skating issue and hand-object interpenetration separately. Experiments are conducted on GRAB dataset to demonstrate effectiveness of this proposed method for whole-body grasping motion generation with randomly placed unknown objects.

数字人抓取生成运动规划

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。