自动采集真实抓取数据,效率提升近5倍且成功率翻倍。
AutoDex: An Automated Real-World System for Dexterous Grasping Data Collection

- 用20台相机实现遮挡下的物体定位,全自动执行与重置抓取实验。
- 收集3593次真实抓取试验,相比人工操作效率提升4.8倍。
- 数据经物理验证,可显著提升后续抓取模型的成功率。
学习鲁棒的灵巧抓取需要记录真实抓取尝试物理结果的数据。这类数据难以大规模获取:远程操控虽能获得有效物理反馈但耗时且依赖操作者,而基于仿真的生成方式虽廉价可扩展,却无法保证接触有效性。一个自然的解决方案是生成候选抓取并在真实硬件上验证,但这只有在感知、执行、标注和重置整个流程无需人工干预时才能规模化。我们提出 AutoDex,一个闭环自动化的真实世界数据采集系统:针对每个可替换生成器输出的候选动作,系统通过密集20相机感知在严重手物遮挡下定位物体,执行带碰撞监控的机器人运动,标记是否成功完成抓取并保持,主动重置物体以暴露更多稳定姿态下的候选抓取。最终形成一个可重复使用的、带有物理标签的抓取试验数据库,下游系统可通过检索和可行性过滤进行查询。使用 AutoDex,我们在100种不同物体上,对Allegro和Inspire机械手完成了3,593次抓取试验,包含同步多视角观测和机器人状态日志。与匹配的500轨迹人工操作相比,AutoDex仅需10.3小时,而人工需49.4小时,效率提升4.8倍;从AutoDex验证的数据库中检索到的抓取,成功率达76%,远高于仅仿真验证的34%。代码与数据将公开发布。
原文摘要 · Abstract (English)
Learning robust dexterous grasping requires real-world data that records the physical outcomes of grasp attempts. Such data is hard to obtain at scale: teleoperation yields valid physical outcomes but is slow and operator-biased, while simulation-based generation is cheap and scalable but cannot certify contact validity. A natural solution is to generate candidate grasps and verify them on real hardware, but this scales only if the entire collection loop (perception, execution, labeling, and reset) runs without human intervention. We present AutoDex, an automated real-world data-collection system that closes this loop: for each candidate from a replaceable generator, it localizes the object under severe hand-object occlusion with dense 20-camera perception, executes collision-monitored robot motions, labels lift-and-hold success or failure, and actively resets the object between trials to expose additional candidates across stable poses. The result is a reusable database of physically labeled grasp trials that downstream systems can query by retrieval and feasibility filtering. Using AutoDex, we collect 3,593 grasp trials across Allegro and Inspire hands on 100 diverse objects, with synchronized multi-view observations and robot-state logs. For a matched 500-trajectory collection, AutoDex requires 10.3 h versus 49.4 h for teleoperation, yielding a 4.8x throughput improvement, and grasps retrieved from the AutoDex-validated database succeed 76% versus 34% for simulation-only validation. Code and data will be publicly released.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。