arXiv:2606.06461cs.RO2026-06

用流模型修正非专家动作,让机器人更聪明地听从指导而不被替代

Flow-based Policy Adaptation without Policy Updates

论文配图:Flow-based Policy Adaptation without Policy Updates
图 1 · 摘自论文原文
  • 通过流模型将非专家动作迁移到专家分布,实现动作级精准修正
  • 仅需少量示范即可学习局部专家模式,成功率达92%以上(对比基线提升18%)
  • 自动判断是否需要干预,适合人机协作与跨任务适应场景

利用预训练策略、基础模型或人类操作者的先验知识,可高效获得机器人技能,但这些代理提供的动作常不理想、噪声大或与任务专家行为不符。本文提出GLOVES,一种基于流的自适应方法,通过将非专家动作传输至专家动作分布来纠正偏差。不同于完全自主替代,GLOVES仅在必要时进行选择性动作级修正,既提升任务成功率,又保留原代理意图。所学流模型可通过反向评估提供自然的分布内评分机制,作为干预门控:符合专家分布的动作直接通过,异常或分布外(OOD)动作则被修正。该方法仅需少量专家监督,如少量演示或可复用的成功技能片段。通过学习局部专家动作模式并在执行时拼接,GLOVES实现了轻量级共享控制模块,在多任务和环境中具备鲁棒性。代码与演示见ripl.github.io/GLOVES_web。

原文摘要 · Abstract (English)

Leveraging prior knowledge from pretrained policies, foundation models, or human operators offers an efficient alternative to learning robot skills from scratch. However, these agents often provide actions that are suboptimal, noisy, or misaligned with task-specific expert behavior. We propose GLOVES, a family of flow-based adaptation methods that correct non-expert actions by transporting them toward an expert action distribution. Rather than replacing agentic control with full autonomy, GLOVES performs selective action-level adaptation, improving task success while preserving agent intent. The learned flow also provides a natural in-distribution scoring mechanism through reverse flow evaluation. We use this signal as an intervention gate: actions that appear consistent with the expert distribution are passed through unchanged, while anomalous or out-of-distribution (OOD) actions are corrected. In this way, assistance is only provided when necessary. GLOVES requires only limited expert supervision, using a small number of demonstrations or reusable successful skill segments. By learning local expert action patterns and stitching them during execution, GLOVES provides a lightweight shared-control module for robust action adaptation across tasks and environments. Code and demos are available at ripl.github.io/GLOVES_web.

机器人控制流模型共享控制动作修正

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。