构建首个长时程双臂协同基准,推动机器人高阶协作研究
BiCoord: A Bimanual Manipulation Benchmark towards Long-Horizon Spatial-Temporal Coordination
- 设计需持续跨任务交互与动态角色切换的复杂双臂任务
- 提出时空多维度量化指标,系统评估双臂协同水平
- 揭示现有算法在长期紧密协作中存在根本性瓶颈
双臂协同操作是实现机器人类人灵巧性的关键。现有仿真基准如RoboTwin和RLBench2虽推动了数据驱动学习,但任务周期短且协同松散,难以体现真实世界双臂行为中的时空耦合特性。为此,我们提出BiCoord,一个面向长时程、强协同的双臂操作基准。该基准包含多样任务,要求双臂持续互依赖并跨越多个子目标动态交换角色。同时,我们提出一套从时间、空间及时空联合视角的量化评价指标,实现对双臂协作的系统测量。实验表明,代表性操控策略(如DP、RDT、Pi0和OpenVLA-OFT)在长时间、高度耦合任务上表现不佳,暴露出实现长时程紧密协同的根本挑战。我们希望BiCoord能成为研究长时程协作操纵的基础,并激励未来协调感知的机器人学习研究。所有数据集、代码与补充材料可访问 https://buaa-colalab.github.io/BiCoord/。
原文摘要 · Abstract (English)
Bimanual manipulation, i.e., the coordinated use of two robotic arms to complete tasks, is essential for achieving human-level dexterity in robotics. Recent simulation benchmarks, e.g., RoboTwin and RLBench2, have advanced data-driven learning for bimanual manipulation. However, existing tasks are short-horizon and only loosely coordinated, failing to capture the spatial-temporal coupling inherent in real-world bimanual behaviors. To address this gap, we introduce BiCoord, a benchmark for long-horizon and tightly coordinated bimanual manipulation. Specifically, BiCoord comprises diverse tasks that require continuous inter-arm dependency and dynamic role exchange across multiple sub-goals. Also, we propose a suite of quantitative metrics that evaluate coordination from temporal, spatial, and spatial-temporal perspectives, enabling systematic measurement of bimanual cooperation. Experimental results show that representative manipulation policies, e.g., DP, RDT, Pi0, and OpenVLA-OFT, struggle with long-duration and highly coupled tasks, revealing fundamental challenges in achieving long-horizon and tight coordination tasks. We hope BiCoord can serve as a foundation for studying long-horizon cooperative manipulation and inspire future research on coordination-aware robotic learning. All datasets, codes and supplements could be found at https://buaa-colalab.github.io/BiCoord/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。