arXiv:2605.13757cs.RO2026-05被引 5

通过筛选关键帧提升视觉语言动作模型训练效率

FrameSkip: Learning from Fewer but More Informative Frames in VLA Training

论文配图:FrameSkip: Learning from Fewer but More Informative Frames in VLA Training
图 1 · 摘自论文原文
  • 按动作变化、视觉-动作一致性等指标筛选高价值帧
  • 仅保留20%关键帧,成功率提升至76.15%(原为66.50%)
  • 无需修改模型结构,适配各类机器人任务训练

视觉-语言-动作(VLA)策略通常从密集的机器人示范轨迹中训练,每帧都被视为同等有用的监督信号。我们指出这种做法造成时间监督失衡:长时低变化段占主导,而对操作至关重要的接触、抓取、释放等过渡阶段仅稀疏出现。为此提出FrameSkip,一种数据层帧选择框架,基于动作变化、视觉-动作一致性、任务进展先验和夹爪状态转移保真度评分帧,并在目标保留率下重映射训练样本。该方法仅作用于数据加载器,不改变VLA架构、动作头、训练目标和推理流程。在RoboCasa-GR1、SimplerEnv和LIBERO三个基准上,FrameSkip相比全帧训练和简单帧采样方法,显著改善成功与保留率权衡,跨三者平均成功率达76.15%,而全帧训练为66.50%,且仅保留主设置中20%的唯一帧。

原文摘要 · Abstract (English)

Vision-Language-Action (VLA) policies are commonly trained from dense robot demonstration trajectories, often collected through teleoperation, by sampling every recorded frame as if it provided equally useful supervision. We argue that this convention creates a temporal supervision imbalance: long low-change segments dominate the training stream, while manipulation-critical transitions such as alignment, contact, grasping, and release appear only sparsely. We introduce FrameSkip, a data-layer frame selection framework that scores trajectory frames using action variation, visual-action coherence, task-progress priors, and gripper-transition preservation, then remaps training samples toward high-importance frames under a target retention ratio. Because FrameSkip operates only in the dataloader, it leaves the VLA architecture, action head, training objective, and inference procedure unchanged. Across RoboCasa-GR1, SimplerEnv, and LIBERO, FrameSkip improves the success-retention trade-off over full-frame training and simpler frame selection variants, achieving a macro-average success rate of 76.15% across the three benchmarks compared with 66.50% for full-frame training while using a compressed trajectory view that retains 20% of unique frames in the main setting.

机器人学习帧选择多模态训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。