让机器人演示采集实时知道动作能否执行,避免无效数据。
FeasibleCap: Real-Time Embodiment Constraint Guidance for In-the-Wild Robot Demonstration Collection
- 采集时用目标机器人模型检查可达性、关节速度和碰撞,实时反馈
- 在抓取和投掷任务中提升重放成功率,减少不可行帧比例
- 无需学习模型或头显,适合真实场景下快速收集可用演示
夹持器手持数据采集将演示获取与机器人硬件解耦,但轨迹是否能在目标机器人上执行直到后续重放验证才可知。失败演示因此显著增加有效每条可用轨迹的成本。现有采集期反馈系统依赖头戴AR/VR设备、机器人在环硬件或学习的动力学模型;实时可执行性反馈尚未融入夹持器手持采集范式。本文提出FeasibleCap,一种将实时可执行性引导集成到无机器人的采集流程中的系统。每帧中,FeasibleCap基于目标机器人模型检查可达性、关节速率限制和碰撞,并通过设备端视觉叠加和触觉提示闭环反馈,使示范者可在采集过程中即时修正动作,无需学习模型、头戴设备或机器人硬件。在抓取-放置和投掷任务中,FeasibleCap提升了重放成功率并降低了不可行帧比例,投掷任务收益最大。仿真实验进一步表明,采集时强制执行可执行性约束不会损害跨机器人平台的迁移性能。软硬件设计已开源。
原文摘要 · Abstract (English)
Gripper-in-hand data collection decouples demonstration acquisition from robot hardware, but whether a trajectory is executable on the target robot remains unknown until a separate replay-and-validate stage. Failed demonstrations therefore inflate the effective cost per usable trajectory through repeated collection, diagnosis, and validation. Existing collection-time feedback systems mitigate this issue but rely on head-worn AR/VR displays, robot-in-the-loop hardware, or learned dynamics models; real-time executability feedback has not yet been integrated into the gripper-in-hand data collection paradigm. We present \textbf{FeasibleCap}, a gripper-in-hand data collection system that brings real-time executability guidance into robot-free capture. At each frame, FeasibleCap checks reachability, joint-rate limits, and collisions against a target robot model and closes the loop through on-device visual overlays and haptic cues, allowing demonstrators to correct motions during collection without learned models, headsets, or robot hardware. On pick-and-place and tossing tasks, FeasibleCap improves replay success and reduces the fraction of infeasible frames, with the largest gains on tossing. Simulation experiments further indicate that enforcing executability constraints during collection does not sacrifice cross-embodiment transfer across robot platforms. Hardware designs and software are available at https://github.com/aod321/FeasibleCap.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。