arXiv:2504.18471cs.ROcs.AI2025-04被引 4

用流匹配优化机器人动作,实现高效持续学习。

Action Flow Matching for Continual Robot Learning

  • 通过动作流匹配直接修正规划动作,而非依赖错误模型探索。
  • 在两台平台上实现34.2%的任务成功率提升,显著加速适应。
  • 无需依赖重放缓冲区,适合资源受限的实时机器人系统。

机器人持续学习旨在使系统能不断适应变化的环境与任务,类比人类的适应能力。核心挑战在于精炼动态模型以支持规划与控制,同时应对安全适应、灾难性遗忘、异常值处理、数据效率以及探索与利用的平衡,且受限于任务需求和机载资源。为此,我们提出一种基于流匹配的生成框架,用于在线对齐机器人动态模型。该方法不依赖错配模型执行动作,而是修正规划动作,使其更贴近模型对齐时应有的行为。我们发现,通过直接转换动作而非在错配模型下探索,机器人能更高效地收集信息,从而加速学习。此外,验证表明该方法可处理演化中且可能不完美的模型,并可选择性降低对重放缓冲区或旧模型快照的依赖。我们在无人地面车辆和四旋翼无人机上验证了该方法,结果凸显其适应性与效率,任务成功率提升达34.2%,展现出实现持续机器人学习的巨大潜力。代码已开源:https://github.com/AlejandroMllo/action_flow_matching。

原文摘要 · Abstract (English)

Continual learning in robotics seeks systems that can constantly adapt to changing environments and tasks, mirroring human adaptability. A key challenge is refining dynamics models, essential for planning and control, while addressing issues such as safe adaptation, catastrophic forgetting, outlier management, data efficiency, and balancing exploration with exploitation -- all within task and onboard resource constraints. Towards this goal, we introduce a generative framework leveraging flow matching for online robot dynamics model alignment. Rather than executing actions based on a misaligned model, our approach refines planned actions to better match with those the robot would take if its model was well aligned. We find that by transforming the actions themselves rather than exploring with a misaligned model -- as is traditionally done -- the robot collects informative data more efficiently, thereby accelerating learning. Moreover, we validate that the method can handle an evolving and possibly imperfect model while reducing, if desired, the dependency on replay buffers or legacy model snapshots. We validate our approach using two platforms: an unmanned ground vehicle and a quadrotor. The results highlight the method's adaptability and efficiency, with a record 34.2\% higher task success rate, demonstrating its potential towards enabling continual robot learning. Code: https://github.com/AlejandroMllo/action_flow_matching.

持续学习动作优化流匹配机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。