自动检测失败,减少人工干预,让机器人系统更高效地适应新环境。
ARMADA: Autonomous Online Failure Detection and Human Shared Control Empower Scalable Real-world Deployment and Adaptation
- 用自主在线检测方法FLOAT识别策略失效,仅在必要时请求人类帮助。
- 检测准确率接近95%,比现有方法高出20%以上。
- 实测中成功率达前代4倍,人工干预减少一半以上,适合多机器人部署。
模仿学习在大规模真实数据上表现出潜力,但预训练策略缺乏领域内数据时表现不佳。人工收集示范成本高,且常含低质量与冗余信息。现有闭环人机协作系统虽能获取领域数据,但需全程人工监控。本文提出ARMADA系统,采用名为FLOAT的自主在线故障检测方法,实现多机器人并行部署,仅在必要时请求人工介入,显著降低对人力依赖。该系统有效提升领域数据获取效率,推动更可扩展的部署与快速场景适应。在四个真实任务中评估显示,FLOAT平均准确率达95%,超越现有最佳方法超20%;相比以往人机协作学习,ARMADA在多轮部署与微调中成功率提升超过4倍,人工干预频率降低2倍以上。
原文摘要 · Abstract (English)
Imitation learning has shown promise in learning from large-scale real-world datasets. However, pretrained policies usually perform poorly without sufficient in-domain data. Besides, human-collected demonstrations entail substantial labour and tend to encompass mixed-quality data and redundant information. As a workaround, human-in-the-loop systems gather domain-specific data for policy post-training, and exploit closed-loop policy feedback to offer informative guidance, but usually require full-time human surveillance during policy rollout. In this work, we devise ARMADA, a multi-robot deployment and adaptation system with human-in-the-loop shared control, featuring an autonomous online failure detection method named FLOAT. Thanks to FLOAT, ARMADA enables paralleled policy rollout and requests human intervention only when necessary, significantly reducing reliance on human supervision. Hence, ARMADA enables efficient acquisition of in-domain data, and leads to more scalable deployment and faster adaptation to new scenarios. We evaluate the performance of ARMADA on four real-world tasks. FLOAT achieves nearly 95% accuracy on average, surpassing prior state-of-the-art failure detection approaches by over 20%. Besides, ARMADA manifests more than 4$\times$ increase in success rate and greater than 2$\times$ reduction in human intervention rate over multiple rounds of policy rollout and post-training, compared to previous human-in-the-loop learning methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。