arXiv:2609.08339cs.ROcs.AI2026-09

用实物图像自动生成可交互的仿真对象与场景,解决双臂操作数据难扩难题。

RoboCousin: Build Your Own Simulation Playground for Robust Bimanual Robotic Manipulation

论文配图:RoboCousin: Build Your Own Simulation Playground for Robust Bimanual Robotic Manipulation
图 1 · 摘自论文原文
  • 输入物体图像自动生成带物理和语义信息的仿真资产
  • 构建多样化的数字孪生场景,保留任务关键关系并生成百万级专家轨迹
  • 适合需要大规模合成数据的机器人研发团队

双臂操作策略需大量多样化的训练数据,但真实机器人采集示范成本高且难以扩展。仿真可高效生成数据,但现有流程受限于封闭资源库和预设场景:新增物体或环境仍需大量工作重建几何、定义物理语义属性、标注交互并集成至任务中。我们提出RoboCousin,一个可扩展的基于仿真的数据生成平台,将用户提供的观测转化为可复用的资产、场景和专家轨迹。基于RoboTwin 2.0,RoboCousin将物体图像转为含视觉与碰撞几何、语义与物理元数据的仿真资产,并自动生成抓取接触候选。它进一步构建数字孪生体,改变物体、背景、布局和语言指令,同时保留任务相关功能与空间关系。相同资产系统支持桌面级与房间级场景构建,具备碰撞感知的基底控制以实现固定工作区外的交互。我们发布RoboCousin-OBD,包含3000多个标注物体实例和50个背景环境,并利用RoboCousin生成超过100万条跨50项任务的专家轨迹。仿真与真实机器人实验表明,自动生成的交互标注媲美人工标注,生成资产提供有效的仿真到现实监督,桌面级孪生体可提升单场景训练的迁移性能。RoboCousin为扩展合成双臂操作数据的规模与覆盖范围提供了实用路径。

原文摘要 · Abstract (English)

Bimanual manipulation policies require large and diverse training datasets, yet collecting demonstrations on physical robots is expensive and difficult to scale. Simulation can generate data efficiently, but existing pipelines typically operate within closed asset libraries and predefined scenes: adding a newly observed object or environment still requires substantial effort to reconstruct geometry, specify physical and semantic properties, annotate interactions, and integrate the result into executable tasks. We present RoboCousin, an extensible simulation-based data-generation platform that turns user-provided observations into reusable assets, scenes, and expert trajectories for bimanual manipulation. Built on RoboTwin~2.0, RoboCousin converts object images into simulation-ready assets with visual and collision geometry, semantic and physical metadata, and automatically generated grasp-contact candidates. It further constructs digital cousins that vary compatible objects, backgrounds, layouts, and language instructions while preserving task-relevant affordances and spatial relations. The same asset system supports tabletop and room-level scene construction, with collision-aware base control for interaction beyond a fixed workspace. We release RoboCousin-OBD, containing more than 3,000 annotated object instances and 50 background environments, and use RoboCousin to generate over one million expert trajectories across 50 tasks. Simulation and real-robot experiments show that the automatically generated interaction annotations are comparable to curated annotations, generated assets provide effective sim-to-real supervision, and tabletop cousins can improve transfer beyond training on a single reconstructed scene. RoboCousin therefore provides a practical path for expanding both the scale and coverage of synthetic bimanual manipulation data.

机器人仿真双臂操作数据生成数字孪生

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。