arXiv:2505.21437cs.GRcs.CV2025-05NeurIPS被引 13

通过协同扩散噪声优化,实现人形物体操作中全身动作的高精度联动。

CoDA: Coordinated Diffusion Noise Optimization for Whole-Body Manipulation of Articulated Objects

论文配图:CoDA: Coordinated Diffusion Noise Optimization for Whole-Body Manipulation of Articulated Objects
图 1 · 摘自论文原文
  • 分体训练身体、双手扩散模型,通过运动链梯度流实现动作协调。
  • 使用基点集统一表征手与物体空间关系,提升抓取定位精度。
  • 支持仅用手部数据生成全身动作,适用于虚拟人与机器人控制。

生成包含身体运动、手部运动与物体运动的全身操作动作是虚拟人与机器人领域的重要挑战。核心难点在于:一、手部与身体运动需紧密协调;二、关节物体操作自由度高,需精确控制手指位置以触发可动部件。为此,我们提出一种协同扩散噪声优化框架。具体地,针对身体、左手、右手分别训练专用扩散模型,利用人体运动链的梯度传播自然实现动作协调。为提升手物交互精度,采用基于基点集(BPS)的统一表示,将末端执行器位置编码为到同一BPS的距离,从而捕捉手与物体部件间的细粒度空间关系。该表示作为目标引导扩散噪声优化,生成高精度交互动作。大量实验表明,本方法在动作质量与物理合理性上优于现有方法,支持物体姿态控制、边走边操作、仅从手部数据生成全身动作等能力。

原文摘要 · Abstract (English)

Synthesizing whole-body manipulation of articulated objects, including body motion, hand motion, and object motion, is a critical yet challenging task with broad applications in virtual humans and robotics. The core challenges are twofold. First, achieving realistic whole-body motion requires tight coordination between the hands and the rest of the body, as their movements are interdependent during manipulation. Second, articulated object manipulation typically involves high degrees of freedom and demands higher precision, often requiring the fingers to be placed at specific regions to actuate movable parts. To address these challenges, we propose a novel coordinated diffusion noise optimization framework. Specifically, we perform noise-space optimization over three specialized diffusion models for the body, left hand, and right hand, each trained on its own motion dataset to improve generalization. Coordination naturally emerges through gradient flow along the human kinematic chain, allowing the global body posture to adapt in response to hand motion objectives with high fidelity. To further enhance precision in hand-object interaction, we adopt a unified representation based on basis point sets (BPS), where end-effector positions are encoded as distances to the same BPS used for object geometry. This unified representation captures fine-grained spatial relationships between the hand and articulated object parts, and the resulting trajectories serve as targets to guide the optimization of diffusion noise, producing highly accurate interaction motion. We conduct extensive experiments demonstrating that our method outperforms existing approaches in motion quality and physical plausibility, and enables various capabilities such as object pose control, simultaneous walking and manipulation, and whole-body generation from hand-only data.

动作生成扩散模型协同控制机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。