arXiv:2609.07581cs.RO2026-09

让视觉语言动作模型通过情境示范快速适应新任务,无需重新训练。

ICI-VLA: In-Context Imitation with Spatiotemporally Aligned Demonstrations for Vision-Language-Action Models

论文配图:ICI-VLA: In-Context Imitation with Spatiotemporally Aligned Demonstrations for Vision-Language-Action Models
图 1 · 摘自论文原文
  • 用时空对齐的微示范作为上下文,让固定模型在推理时动态调整行为。
  • 在LIBERO上达97.7%成功率,在RoboTwin 2.0上比现有最佳提升19.3个百分点。
  • 适合缺乏数据或算力的实时部署场景,尤其适合机器人操控任务。

视觉-语言-动作(VLA)策略通常通过额外梯度更新来适应新操作环境,但在任务特定数据或计算资源有限时,难以实现快速部署。本文提出ICI-VLA,一种训练与检索框架,使文本-动作视觉语言模型可通过少量测试时示范实现少样本适应。不同于主流基于动作特异性多模态融合的设计,ICI-VLA保持原生文本生成接口;其参数仅在离线训练阶段更新,推理时策略固定,并基于检索到的微示范进行动作生成。该框架将长轨迹分解为短而语义标注的示例,使用动态时间规整(DTW)挖掘正样本,训练RD-编码器以对齐检索上下文与当前子任务的阶段和几何特征。此外引入目标动作掩码机制,通过上下文污染目标减少直接动作复制,增强对当前观测的依赖。ICI-VLA在LIBERO上达到平均97.7%成功,在RoboTwin 2.0上达60.4%,超越已有最高基线19.3个百分点,且在四个物理任务上综合表现达83.2%。结果表明,固定VLA策略可在测试时通过时空对齐示范获得显著性能提升。

原文摘要 · Abstract (English)

Vision-Language-Action (VLA) policies are commonly adapted to new manipulation settings through additional gradient updates, which limits rapid deployment when task-specific data or compute is scarce. We present ICI-VLA, a training and retrieval framework that equips a text-action VLM with few-shot test-time adaptation through in-context demonstrations. Unlike mainstream VLA designs based on action-specific multimodal fusion, ICI-VLA retains the native text-generation interface. ICI-VLA updates its parameters only during offline training; at inference, the policy remains fixed and conditions action generation on retrieved micro-demonstrations. The framework decomposes long trajectories into short, semantically labeled examples and trains an RD-Encoder with positives mined by Dynamic Time Warping (DTW), aligning the retrieved context with the phase and geometry of the current subtask. We further introduce Target Action Masking, a context-corruption objective designed to reduce direct action copying and increase reliance on the current observation. ICI-VLA reaches average success rates of 97.7% on LIBERO and 60.4% on RoboTwin 2.0, exceeding the highest reported baseline average on RoboTwin 2.0 by 19.3 percentage points. It also achieves 83.2% across four physical tasks. These results indicate that a fixed VLA policy can benefit from conditioning on spatiotemporally aligned demonstrations at test time.

视觉语言动作少样本学习机器人控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。