arXiv:2412.06702cs.GRcs.RO2024-12被引 13

让虚拟人物在复杂场景中自然完成捡放动作,支持多种物体和障碍布局。

CHOICE: Coordinated Human-Object Interaction in Cluttered Environments for Pick-and-Place Actions

  • 分层目标驱动:先规划双手关键帧,再生成轨迹引导。
  • 支持不同物体形状与障碍布局,生成自然的拾取放置动作。
  • 用卡尔曼滤波实现平滑过渡,适合动画与虚拟角色控制场景。

在复杂多障碍场景中模拟人与物体的交互(如捡放任务)极具挑战,因物体几何形态与关节结构差异大,且运动数据稀疏、任务间过渡动作匮乏,导致泛化困难。为此,本文提出一个分层目标驱动系统:首先设计双臂调度器,基于用户选择的目标对象抽象信号,规划双手关键帧;其次开发神经隐式规划器,在不同物体类型与障碍布局下生成手部轨迹指导;最后提出基于线性动态模型的DeepPhase控制器,结合卡尔曼滤波,在频域实现平滑过渡,提升多目标控制的真实感与效率。系统可生成适应物体几何、容器关节及场景布局的多样化自然动作。

原文摘要 · Abstract (English)

Animating human-scene interactions such as pick-and-place tasks in cluttered, complex layouts is a challenging task, with objects of a wide variation of geometries and articulation under scenarios with various obstacles. The main difficulty lies in the sparsity of the motion data compared to the wide variation of the objects and environments as well as the poor availability of transition motions between different tasks, increasing the complexity of the generalization to arbitrary conditions. To cope with this issue, we develop a system that tackles the interaction synthesis problem as a hierarchical goal-driven task. Firstly, we develop a bimanual scheduler that plans a set of keyframes for simultaneously controlling the two hands to efficiently achieve the pick-and-place task from an abstract goal signal such as the target object selected by the user. Next, we develop a neural implicit planner that generates guidance hand trajectories under diverse object shape/types and obstacle layouts. Finally, we propose a linear dynamic model for our DeepPhase controller that incorporates a Kalman filter to enable smooth transitions in the frequency domain, resulting in a more realistic and effective multi-objective control of the character.Our system can produce a wide range of natural pick-and-place movements with respect to the geometry of objects, the articulation of containers and the layout of the objects in the scene.

动作生成人机交互虚拟角色

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。