arXiv:2606.03598cs.ROcs.AI2026-06

解决机器人视觉语言模型持续学习中的遗忘问题,提升长期技能保持能力。

PHASER: Phase-Aware and Semantic Experience Replay for Vision-Language-Action Models

论文配图:PHASER: Phase-Aware and Semantic Experience Replay for Vision-Language-Action Models
图 1 · 摘自论文原文
  • 按动作阶段分配记忆容量,确保关键子技能不被忽略
  • 动态识别高遗忘风险阶段并优先重放,提升学习效率
  • 自动检测动作边界,实现无需人工标注的持续学习

视觉-语言-动作(VLA)模型在语言控制的机器人操作中表现卓越。但在开放环境中持续学习新技能时,极易引发对已有行为的灾难性遗忘。尽管经验回放(ER)是常用缓解策略,但传统均匀采样未能匹配操作轨迹的时间特性,导致短暂但关键的子技能被严重低估,且忽略不同历史任务的遗忘差异。为此,我们提出PHASER,一种与架构无关的持续学习框架。它采用以阶段为中心的容量分配机制,保障所有子技能获得相等记忆支持,并结合多模态干扰路由策略,动态优先重放高遗忘风险的历史阶段。为实现完全自主的终身适应,我们集成Auto-PC——一个轻量级管道,结合无监督动作信号变化点检测与基于VLM的语义验证,自动提取时间边界,避免密集人工标注。在三个VLA骨干模型上对LIBERO持续学习基准进行评估,PHASER相比同预算ER显著提升平均成功率(ASR),最高达31%;在LIBERO-Goal CL设置下,最终达到87.8%的ASR。

原文摘要 · Abstract (English)

Vision-Language-Action (VLA) models have achieved remarkable success in language-conditioned robotic manipulation. However, deploying these models in open-ended environments requires continuously acquiring novel skills, a process that inevitably triggers severe catastrophic forgetting of previously learned behaviors. While experience replay (ER) serves as a standard mitigating strategy, naive uniform sampling fundamentally misaligns with the temporal characteristics of manipulation trajectories. It systematically under-samples brief but causally critical sub-skills, leading to phase starvation, and completely overlooks the varying degrees of forgetting across historical tasks. To overcome these limitations, we introduce PHASER, an architecture-agnostic continual learning framework. PHASER employs a phase-centric capacity allocation to guarantee equal memory support for all sub-skills, coupled with a multi-modal interference routing strategy that dynamically prioritizes historical phases at high risk of forgetting. Furthermore, to enable fully autonomous lifelong adaptation, we integrate Auto-PC, a lightweight pipeline combining unsupervised action-signal change-point detection with VLM-based semantic verification to extract temporal boundaries without intensive manual supervision. Evaluated across three VLA backbones on LIBERO continual learning suites, PHASER yields substantial empirical improvements, increasing Average Success Rate (ASR) by up to 31% over matched-budget ER and achieving an 87.8% final ASR on the LIBERO-Goal CL setting.

持续学习机器人操作经验回放多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。