arXiv:2512.21586cs.LG2025-12NeurIPS被引 5

用视频学动作,仅需少量尝试就能达到专家水平。

Videos are Sample-Efficient Supervisions: Behavior Cloning from Videos via Latent Representations

  • 从视频中自监督提取动作相关隐变量,再通过动态预测实现无监督动作学习。
  • 在28个任务中,24个任务表现优于现有方法,仅靠几次交互即达高精度。
  • 适合做视觉策略学习且数据有限的场景,尤其适合无奖励信号环境。

人类能仅通过几次试错就从视频中高效获取知识并学会技能,但对自主智能体而言仍具挑战:视觉输入复杂、缺乏动作或奖励信号,且交互步数受限。本文提出一种新颖的无监督、样本高效的模仿学习框架——基于隐表示的行为克隆(BCV-LR)。该方法通过自监督任务从高维视频中提取与动作相关的隐特征,并利用基于动态的无监督目标预测连续帧间的隐动作。预训练的隐动作在线上通过少量真实交互进行微调并映射到真实动作空间,完成策略克隆;被克隆的策略又反哺经验,推动隐动作持续优化,形成迭代改进闭环。我们在多个高难度视觉任务上进行了广泛实验,涵盖离散控制与连续控制。结果表明,BCV-LR仅需极少交互即可实现有效(部分任务达专家级)性能,在24/28个任务上超越现有最先进的视频模仿学习方法及提供奖励信号的强化学习方法,样本效率显著领先。据我们所知,这是首次证明视频可支撑极低样本量的视觉策略学习,且无需任何额外专家监督。

原文摘要 · Abstract (English)

Humans can efficiently extract knowledge and learn skills from the videos within only a few trials and errors. However, it poses a big challenge to replicate this learning process for autonomous agents, due to the complexity of visual input, the absence of action or reward signals, and the limitations of interaction steps. In this paper, we propose a novel, unsupervised, and sample-efficient framework to achieve imitation learning from videos (ILV), named Behavior Cloning from Videos via Latent Representations (BCV-LR). BCV-LR extracts action-related latent features from high-dimensional video inputs through self-supervised tasks, and then leverages a dynamics-based unsupervised objective to predict latent actions between consecutive frames. The pre-trained latent actions are fine-tuned and efficiently aligned to the real action space online (with collected interactions) for policy behavior cloning. The cloned policy in turn enriches the agent experience for further latent action finetuning, resulting in an iterative policy improvement that is highly sample-efficient. We conduct extensive experiments on a set of challenging visual tasks, including both discrete control and continuous control. BCV-LR enables effective (even expert-level on some tasks) policy performance with only a few interactions, surpassing state-of-the-art ILV baselines and reinforcement learning methods (provided with environmental rewards) in terms of sample efficiency across 24/28 tasks. To the best of our knowledge, this work for the first time demonstrates that videos can support extremely sample-efficient visual policy learning, without the need to access any other expert supervision.

模仿学习视频理解样本效率隐表示

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。