arXiv:2606.12072cs.CV2026-06

用自蒸馏让视频模型不靠文字也能解任务,还能在机器人上用。

World Model Self-Distillation: Training World Models to Solve General Tasks

论文配图:World Model Self-Distillation: Training World Models to Solve General Tasks
图 1 · 摘自论文原文
  • 用视觉语言模型生成任务和解法,蒸馏到仅需图像+短指令的执行器。
  • 在两个基准上表现超过原模型,且能迁移到机器人任务中。
  • 无需标注视频数据,适合大规模训练通用视觉世界模型。

预训练的视频生成模型展现出涌现的任务求解能力,但其依赖详细文本描述,难以直接用于规划与决策。现有方法要么将推理外包给语言或视觉-语言模型,要么依赖成对的任务执行视频进行监督微调,成本高且难扩展。本文提出一种可扩展框架,通过自蒸馏结合强化学习激发此类模型的任务求解能力。给定未标注场景图像,视觉语言模型生成候选任务与详细步骤解法;该解法作为条件输入预训练视频扩散模型(演示器),将其行为蒸馏至仅依赖图像与简短任务提示的执行器。这一过程将基于字幕生成的知识转移为指令驱动的任务求解,无需标注任务-视频对。进一步利用视觉语言模型反馈进行强化学习优化执行器,利用判断视频是否满足任务比生成解法更易的不对称性。在新提出的WorldTasks-Benchmark和DreamGen机器人基准上的实验表明,执行器在基于VLM的评估协议下超越演示器,并在机器人任务中表现良好。

原文摘要 · Abstract (English)

Pretrained video generators are promising visual world models that exhibit emergent task-solving abilities; however, their reliance on detailed textual descriptions limits their direct use for planning and decision-making. Existing approaches either outsource this reasoning to language or vision-language models, or rely on supervised fine-tuning with paired task-execution videos, which are costly to collect and difficult to scale. We propose a scalable framework that elicits task-solving ability in such models by combining self-distillation with reinforcement learning. Given an unlabeled scene image, a vision-language model generates a candidate task and a detailed step-by-step solution. The solution conditions a pretrained video diffusion model, the Demonstrator; we distill its behavior into an Executor conditioned only on the image and a short task prompt. This transfers execution knowledge from caption-guided generation to instruction-conditioned task solving without curated task-video supervision. We further improve the Executor with reinforcement learning from VLM feedback, exploiting the asymmetry between judging whether a sampled video satisfies a task and generating the solution. Experiments on our proposed WorldTasks-Benchmark and the DreamGen robotics benchmark show that the Executor surpasses the Demonstrator under our VLM-based evaluation protocol and transfers competitively to robotic tasks.

世界模型自蒸馏强化学习视频生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。