arXiv:2608.19589cs.ROcs.CV2026-08中稿 · PRCV 2026

提出新方法让机器人持续学新技能而不忘旧技能。

OrthoSkillVLA: Continual Skill Learning via Gradient-Informed Skill Subspace Adaptation

论文配图:OrthoSkillVLA: Continual Skill Learning via Gradient-Informed Skill Subspace Adaptation
图 1 · 摘自论文原文
  • 分区域约束模型参数更新,保护语义与动作模式
  • 新技能学习后旧技能准确率仍保持90%以上
  • 适合需要长期积累技能的机器人应用

预训练视觉-语言-动作(VLA)模型为机器人学习提供强大基础,但顺序适应多样技能时会干扰先前技能的表示与速度映射,导致灾难性遗忘。现有架构方法虽提升保留能力,但增加推理开销;子空间约束方法对全模型施加统一约束,缺乏针对性。我们分析VLA内部组件的差异,发现视觉语言模型(VLM)具备广泛语义表征,易容量耗尽;动作头(ActionHead)将语义转化为局部速度模式,对扰动高度敏感;最终速度解码器作为读出层,冻结则形成表达瓶颈,更新又可能覆盖已有映射。为此,我们提出OrthoSkillVLA:一种无需示范回放的参数高效持续技能学习框架。针对表征异质性,对VLM和ActionHead分别施加独立正交子空间约束,保留可复用的语义容量并保护局部速度模式。对于输出层,引入轻量级特征感知的MoE解码器,每项技能分配一个紧凑专家,训练免费路由器根据特征空间相似性选择专家。大量模拟与真实世界实验及消融研究证明,OrthoSkillVLA在学习新技能的同时显著保留旧技能性能。

原文摘要 · Abstract (English)

Pretrained Vision-Language-Action models provide a strong foundation for robot learning, but sequentially adapting them to diverse skills can perturb the representations and velocity mappings used by previous skills, leading to catastrophic forgetting. Architecture-based approaches improve retention by isolating skills but lead to increased inference footprint. Recent subspace-constrained methods restrict parameter updates in an orthogonal subspace to minimize interference but impose a unified constraint on the entire model. We analyze the distinct roles of internal VLA components and identify two VLA-specific challenges. First, the VLM maintains broad semantic representations, making it vulnerable to capacity exhaustion, whereas the ActionHead refines semantics into localized velocity patterns that are highly sensitive to perturbations. Second, the final velocity decoder serves as a readout layer. Freezing it forms an output-stage expressivity bottleneck, while updating it risks overwriting previous velocity mappings. To this end, we propose OrthoSkillVLA, a parameter-efficient framework for continual skill learning in pretrained VLA models without demonstration replay. Given the representation heterogeneity, we impose separate subspace constraints on the VLM and ActionHead, preserving reusable semantic capacity while protecting localized velocity patterns. For the output layer, we introduce a lightweight feature-aware MoE decoder, where each skill is allocated a compact expert and a training-free router selects the expert according to feature-space affinity. Extensive simulated and real-world evaluations, together with ablations, demonstrate that OrthoSkillVLA better preserves prior skills while acquiring new ones.

机器人学习持续学习VLA模型参数效率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。