arXiv:2603.20236cs.RO2026-03

用能量模型将单手技能组合成双手操作,少数据也能高效执行。

EnergyAction: Unimanual to Bimanual Composition with Energy-Based Models

  • 以能量模型融合单手策略,实现双手动作的可组合生成。
  • 在仅需少量双手数据下,仿真与真实场景表现均优于现有方法。
  • 动态调整去噪步数,兼顾高质量输出与计算效率,适合机器人灵巧操作研究者。

近期单手操作策略在大量训练数据和成熟模型架构支持下,在多种机器人任务中取得显著进展。然而,由于缺乏双手示范数据及双臂动作协调的复杂性,将能力扩展至双手操作仍具挑战。现有方法或依赖大量双手数据,或无法有效利用预训练的单手策略。为此,本文提出EnergyAction,一种基于能量模型(EBMs)的新型框架,通过组合方式将单手操作策略迁移至双手任务。具体包含三项创新:首先,将单手策略建模为能量模型,并利用其可组合特性融合左右臂动作,实现单手策略到双手策略的融合;其次,引入基于能量约束的时空协调机制,确保生成动作在时间上连贯、空间上可行;第三,提出两种能量感知的去噪策略,根据动作质量评估动态调整去噪步数,既保证动作质量,又比固定步数方法更具计算效率。实验表明,EnergyAction在仅需少量双手数据的情况下,即可在仿真与真实世界任务中实现优异性能。

原文摘要 · Abstract (English)

Recent advances in unimanual manipulation policies have achieved remarkable success across diverse robotic tasks through abundant training data and well-established model architectures. However, extending these capabilities to bimanual manipulation remains challenging due to the lack of bimanual demonstration data and the complexity of coordinating dual-arm actions. Existing approaches either rely on extensive bimanual datasets or fail to effectively leverage pre-trained unimanual policies. To address this limitation, we propose \textbf{EnergyAction}, a novel framework that compositionally transfers unimanual manipulation policies to bimanual tasks through the Energy-Based Models (EBMs). Specifically, our method incorporates three key innovations. First, we model individual unimanual policies as EBMs and leverage their compositional properties to compose left and right arm actions, enabling the fusion of unimanual policies into a bimanual policy. Second, we introduce an energy-based temporal-spatial coordination mechanism through energy constraints, ensuring the generated bimanual actions are both temporal coherence and spatial feasibility. Third, we propose two different energy-aware denoising strategies that dynamically adapt denoising steps based on action quality assessment. These strategies ensure the generation of high-quality actions while maintaining superior computational efficiency compared to fixed-step denoising approaches. Experimental results demonstrate that EnergyAction effectively transfers unimanual knowledge to bimanual tasks, achieving superior performance on both simulated and real-world tasks with minimal bimanual data.

机器人操作能量模型双手协作策略迁移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。