研究机器人误判成功任务时,仅靠关节数据能否发现错误。
How Visible Are Silent Manipulation Failures? An Observability Study of False-Success Detection in Simulated Robot Episodes
- 用仿真环境制造失败但标记为成功的任务,测试仅凭关节信息能否识别错误
- 立方体搬运任务中关节数据可基本还原错误,插销任务则需视觉才能补足
- 结果提示:传感器噪声会大幅削弱检测能力,实际应用中挑战更大
机器人模仿学习策略依赖训练数据中的成功标签,而这些标签通常由机器人自身成功判断机制生成。一种严重错误是“假成功”:任务实际失败,但系统却标记为成功。本文聚焦一个实际问题:一旦任务已被标记为成功,有多少信息足以推翻该标签?我们构建了两个双臂ALOHA任务的仿真测试平台,通过环境扰动引入失败,以模拟器的特权状态作为真实标签(检测器不可见),并仅保留机器人标记为成功的片段。对比仅使用本体感知的检测器与基于视觉的检测器,发现恢复能力差异显著:在立方体搬运任务中,关节数据几乎可完全还原错误;而在插销插入任务中,本体感知仅能部分识别,视觉检测器填补了主要差距。此外,我们发现本体感知的可区分性依赖于远低于现实传感器噪声水平的速度差异,表明结果是理想化上限,受无噪声仿真器放大影响。代码与评估流程已开源。
原文摘要 · Abstract (English)
Imitation-learning policies for robot manipulation inherit the quality of the success labels attached to their training episodes, and those labels are usually produced by the robot's own success check. A particularly damaging error is the false success: an episode the robot logs as a success when the task outcome was actually wrong. We ask a narrow but practical question about these episodes. Once an episode has already been flagged as a success, how much of the information needed to overturn that label is present in proprioception, and how much requires vision? We build a simulated testbed on two bimanual ALOHA tasks, induce failures through environment perturbations rather than label edits, label every episode by privileged simulator state that the detector never sees, and keep only episodes the robot flagged as successful. We then compare detectors restricted to proprioception against a vision-based detector. We find that recoverability spans a wide range: in cube transfer the false successes are almost fully recoverable from joint data alone, while in peg insertion proprioception recovers only part of them and a vision detector closes most of the gap. We also show that the proprioceptive separability we measure rests on velocity differences far below any realistic sensor noise floor, so it is best read as an optimistic upper bound that a noiseless simulator inflates. We release the generation and evaluation pipeline.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。