通过分析操作员指令与执行的差异,让机器人学会感知力并自适应补偿延迟和摩擦。
Mind the Gap: Learning Implicit Impedance in Visuomotor Policies via Intent-Execution Mismatch
- 用指令克隆替代执行克隆,学习操作员的控制意图
- 利用指令与执行的偏差,实现隐式力感知和动态补偿
- 适合低成本无传感器机械臂做复杂抓取和动态跟踪
遥操作依赖操作员作为闭环控制器,主动补偿硬件缺陷,如延迟、机械摩擦和缺乏显式力反馈。标准行为克隆(BC)仅模仿机器人的执行轨迹,忽略了这种补偿机制。本文提出双状态条件框架,将学习目标转为“意图克隆”(主控指令)。我们认为,指令-执行差异并非噪声,而是编码了隐式交互力的关键信号,并揭示了操作员克服系统动态的策略。通过预测主控意图,策略可生成“虚拟平衡点”,实现隐式阻抗控制。同时,通过显式依赖历史差异,模型完成隐式系统辨识,将跟踪误差视为外部力以闭合控制回路。为应对推理延迟造成的时序断层,我们进一步将策略建模为轨迹补全器,确保连续控制。在无传感器、低成本双臂系统上验证,结果表明:面对接触丰富的操作和动态跟踪任务,标准执行克隆因无法克服接触刚度和跟踪滞后而失败,而我们的差异感知方法取得显著成功。这为低成本硬件提供了一种极简的行为克隆框架,无需显式力传感即可实现力感知与动态补偿。
原文摘要 · Abstract (English)
Teleoperation inherently relies on the human operator acting as a closed-loop controller to actively compensate for hardware imperfections, including latency, mechanical friction, and lack of explicit force feedback. Standard Behavior Cloning (BC), by mimicking the robot's executed trajectory, fundamentally ignores this compensatory mechanism. In this work, we propose a Dual-State Conditioning framework that shifts the learning objective to "Intent Cloning" (master command). We posit that the Intent-Execution Mismatch, the discrepancy between master command and slave response, is not noise, but a critical signal that physically encodes implicit interaction forces and algorithmically reveals the operator's strategy for overcoming system dynamics. By predicting the master intent, our policy learns to generate a "virtual equilibrium point", effectively realizing implicit impedance control. Furthermore, by explicitly conditioning on the history of this mismatch, the model performs implicit system identification, perceiving tracking errors as external forces to close the control loop. To bridge the temporal gap caused by inference latency, we further formulate the policy as a trajectory inpainter to ensure continuous control. We validate our approach on a sensorless, low-cost bi-manual setup. Empirical results across tasks requiring contact-rich manipulation and dynamic tracking reveal a decisive gap: while standard execution-cloning fails due to the inability to overcome contact stiffness and tracking lag, our mismatch-aware approach achieves robust success. This presents a minimalist behavior cloning framework for low-cost hardware, enabling force perception and dynamic compensation without relying on explicit force sensing. Videos are available on the \href{https://xucj98.github.io/mind-the-gap-page/}{project page}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。