arXiv:2506.12678cs.ROcs.CV2025-06被引 6

通过功能对应关系,让机器人在陌生环境中复用旧经验。

Adapting by Analogy: OOD Generalization of Visuomotor Policies via Functional Correspondence

  • 用功能相似性判断哪些旧经验可迁移到新环境
  • 仅需少量专家反馈就能提升对陌生物体的适应能力
  • 适合需要快速部署的现实机器人任务

基于行为克隆训练的端到端视觉-运动策略虽能生成复杂多模态机器人动作,但在部署时面对分布外(OOD)视觉变化(如物体、背景或环境改变)仍表现不稳定。以往方法需在OOD条件下收集修正示范,成本高且低效。我们发现,只要任务在功能上相似,分布内(ID)行为可直接迁移至分布外场景。例如,处理标准笔的动作可用于处理外观不同的铅笔。核心挑战在于识别哪些ID观察与当前OOD观察功能对应。我们提出由专家提供这种功能对应关系:首先检测是否为OOD并判断最相似训练样本是否产生不同行为;其次请求功能对应反馈以消除歧义;最后用对应ID样本干预当前决策,实现部署时的泛化。我们在Franka Panda机械臂上验证了该方法,在多种真实世界操作任务中,仅需少量反馈即可显著提升基于扩散模型的视觉策略对分布外物体和环境的泛化性能。

原文摘要 · Abstract (English)

End-to-end visuomotor policies trained using behavior cloning have shown a remarkable ability to generate complex, multi-modal low-level robot behaviors. However, at deployment time, these policies still struggle to act reliably when faced with out-of-distribution (OOD) visuals induced by objects, backgrounds, or environment changes. Prior works in interactive imitation learning solicit corrective expert demonstrations under the OOD conditions -- but this can be costly and inefficient. We observe that task success under OOD conditions does not always warrant novel robot behaviors. In-distribution (ID) behaviors can directly be transferred to OOD conditions that share functional similarities with ID conditions. For example, behaviors trained to interact with in-distribution (ID) pens can apply to interacting with a visually-OOD pencil. The key challenge lies in disambiguating which ID observations functionally correspond to the OOD observation for the task at hand. We propose that an expert can provide this OOD-to-ID functional correspondence. Thus, instead of collecting new demonstrations and re-training at every OOD encounter, our method: (1) detects the need for feedback by first checking if current observations are OOD and then identifying whether the most similar training observations show divergent behaviors, (2) solicits functional correspondence feedback to disambiguate between those behaviors, and (3) intervenes on the OOD observations with the functionally corresponding ID observations to perform deployment-time generalization. We validate our method across diverse real-world robotic manipulation tasks with a Franka Panda robotic manipulator. Our results show that test-time functional correspondences can improve the generalization of a vision-based diffusion policy to OOD objects and environment conditions with low feedback.

机器人泛化交互学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。