arXiv:2511.06202cs.RO2025-11中稿 · ICRA被引 8

让机器人模型快速适应特定任务,还能记住失败经验不遗忘。

ExpReS-VLA: Specializing Vision-Language-Action Models Through Experience Replay and Retrieval

  • 用压缩记忆存关键经验,只存特征向量省97%空间
  • 检索旧经验+优先重放成功轨迹,性能提升10.5个百分点
  • 能从失败案例中学习,适合需要稳定表现的机器人部署

视觉-语言-动作(VLA)模型如OpenVLA在机器人操作任务中展现强大零样本泛化能力,但在特定部署环境中的有限任务上,高稳定性比广泛泛化更关键。我们提出ExpReS-VLA,一种通过经验回放与检索增强实现快速设备端适配的方法,通过压缩经验回放和检索增强生成防止灾难性遗忘。该方法利用冻结的OpenVLA视觉主干提取嵌入存储,相比原始图像-动作对降低97%存储开销。部署时,通过余弦相似度检索最相关的前k条历史经验以扩充训练批次,同时使用优先级经验回放缓冲区保留近期成功轨迹。为利用失败尝试,引入阈值混合对比损失(THCL),使模型可从成功与失败示范中学习。LIBERO基准测试显示,空间推理任务准确率从82.6%提升至93.1%,长程任务从61%升至72.3%,在π₀和OpenVLA-OFT等架构上分别提升3.2和1.7点。物理机器人实验在五个任务上达成98%成功率,优于基础微调在分布内(84.7%→98%)和分布外(32%→98%)的表现。仅需12次演示,31秒即可完成适配,运行于单张RTX 5090显卡。

原文摘要 · Abstract (English)

Vision-Language-Action (VLA) models like OpenVLA demonstrate impressive zero-shot generalization across robotic manipulation tasks but struggle to adapt to specific deployment environments where consistent high performance on a limited set of tasks is more valuable than broad generalization. We present EXPierence replayed, REtrieval augmented, Specialized VLA (ExpReS-VLA), a method that enables rapid on-device adaptation of pre-trained VLAs to target domains while preventing catastrophic forgetting through compressed experience replay and retrieval-augmented generation. Our approach maintains a memory-efficient buffer by storing extracted embeddings from OpenVLA's frozen vision backbone, reducing storage requirements by 97% compared to raw image-action pairs. During deployment, ExpReS-VLA retrieves the $k$ most similar past experiences using cosine similarity to augment training batches, while a prioritized experience replay buffer preserves recently successful trajectories. To leverage failed attempts, we introduce Thresholded Hybrid Contrastive Loss (THCL), enabling the model to learn from both successful and unsuccessful demonstrations. Experiments on the LIBERO benchmark show improvements from 82.6% to 93.1% on spatial reasoning and 61% to 72.3% on long-horizon tasks over base OpenVLA, with gains across architectures including $π_0$ (+3.2 points) and OpenVLA-OFT (+1.7 points). Physical robot experiments across five tasks demonstrate 98% success on both in-distribution and out-of-distribution conditions, improving from 84.7% and 32% respectively for naive fine-tuning. Adaptation completes in 31 seconds using 12 demonstrations on a single RTX 5090.

机器人学习经验回放VLA模型快速适配

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。