通过轨迹编辑与力觉预警,提升接触类插入任务的智能学习成功率
Force-Aware Residual DAgger via Trajectory Editing for Precision Insertion with Impedance Control
- 基于优化轨迹编辑学习残差策略,缓解策略偏差问题
- 力觉不匹配时才触发人工干预,减少持续监控需求
- 结合笛卡尔阻抗控制,实现安全稳定的接触操作
模仿学习在高接触精度插入任务中展现巨大潜力,但其实际应用常受协变量偏移及需持续专家监控以应对失败的影响。本文提出轨迹编辑残差数据聚合(TER-DAgger)框架,通过基于优化的轨迹编辑学习残差策略,平滑融合策略回放与人工修正轨迹,提供稳定监督。其次,引入力觉感知的故障预判机制,仅当预测与实测末端执行器力出现差异时才触发人工干预,显著降低对持续专家监控的需求。第三,所有学习策略均在笛卡尔阻抗控制框架下执行,确保接触交互中的顺应性与安全性。大量仿真与真实世界精密插入实验表明,相比行为克隆、人工引导修正、重训练和微调基线,TER-DAgger平均成功率提升超过37%,验证了其在缓解协变量偏移与可扩展部署方面的有效性。
原文摘要 · Abstract (English)
Imitation learning (IL) has shown strong potential for contact-rich precision insertion tasks. However, its practical deployment is often hindered by covariate shift and the need for continuous expert monitoring to recover from failures during execution. In this paper, we propose Trajectory Editing Residual Dataset Aggregation (TER-DAgger), a scalable and force-aware human-in-the-loop imitation learning framework that mitigates covariate shift by learning residual policies through optimization-based trajectory editing. This approach smoothly fuses policy rollouts with human corrective trajectories, providing consistent and stable supervision. Second, we introduce a force-aware failure anticipation mechanism that triggers human intervention only when discrepancies arise between predicted and measured end-effector forces, significantly reducing the requirement for continuous expert monitoring. Third, all learned policies are executed within a Cartesian impedance control framework, ensuring compliant and safe behavior during contact-rich interactions. Extensive experiments in both simulation and real-world precision insertion tasks show that TER-DAgger improves the average success rate by over 37\% compared to behavior cloning, human-guided correction, retraining, and fine-tuning baselines, demonstrating its effectiveness in mitigating covariate shift and enabling scalable deployment in contact-rich manipulation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。