提出一种双臂协作的分层模仿学习框架,提升复杂任务成功率与推理速度。
BiKC+: Bimanual Hierarchical Imitation with Keypose-Conditioned Coordination-Aware Consistency Policies
- 用关键姿态作为子目标,分层生成动作序列,实现双臂协调控制
- 单步推理生成轨迹,实测成功率超基线18.7%,效率显著提升
- 适合需要高可靠性和快速响应的工业双臂机器人场景
机器人在工业制造中因可靠性和高效性而至关重要。它们擅长执行简单重复的单臂任务,但在双臂操作方面仍面临挑战,主要源于双臂协调的复杂性及多阶段流程的处理难题。尽管生成模型融入模仿学习取得进展,但很少方法同时关注任务的多阶段特性与推理速度。多阶段任务中任一阶段的失败或延迟都可能逐级放大,影响后续子阶段表现,最终降低整体任务成功率。本文提出一种新型的关键姿态条件化、协调感知的一致性策略(BiKC+),专为双臂操作设计。该框架采用分层模仿学习结构,包含高层关键姿态预测器与低层轨迹生成器。预测的关键姿态作为各子阶段的目标,引导轨迹生成。轨迹生成器基于一致性模型,仅需一步推理即可结合历史观测与关键姿态生成动作序列。我们创新性地设计了兼顾机器人动作特征与任务操作风格的双臂关键姿态识别方法。仿真与真实世界实验表明,本方法在成功率和运行效率上均显著优于基线方法。代码已开源:https://github.com/JoanaHXU/BiKC-plus。
原文摘要 · Abstract (English)
Robots are essential in industrial manufacturing due to their reliability and efficiency. They excel in performing simple and repetitive unimanual tasks but still face challenges with bimanual manipulation. This difficulty arises from the complexities of coordinating dual arms and handling multi-stage processes. Recent integration of generative models into imitation learning (IL) has made progress in tackling specific challenges. However, few approaches explicitly consider the multi-stage nature of bimanual tasks while also emphasizing the importance of inference speed. In multi-stage tasks, failures or delays at any stage can cascade over time, impacting the success and efficiency of subsequent sub-stages and ultimately hindering overall task performance. In this paper, we propose a novel keypose-conditioned coordination-aware consistency policy tailored for bimanual manipulation. Our framework instantiates hierarchical imitation learning with a high-level keypose predictor and a low-level trajectory generator. The predicted keyposes serve as sub-goals for trajectory generation, indicating targets for individual sub-stages. The trajectory generator is formulated as a consistency model, generating action sequences based on historical observations and predicted keyposes in a single inference step. In particular, we devise an innovative approach for identifying bimanual keyposes, considering both robot-centric action features and task-centric operation styles. Simulation and real-world experiments illustrate that our approach significantly outperforms baseline methods in terms of success rates and operational efficiency. Implementation codes can be found at https://github.com/JoanaHXU/BiKC-plus.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。