用验证器监督训练可执行视频编辑规划器,提升生成质量与自主性。
Plans You Can Check: Verifier-Grounded Learning of an Open-Weight Planner for Executable Video-Editing

- 构建可结构化编辑的开放权重规划器,通过验证器逐步检查修改
- 在3578个任务上,评分从0.620提升至0.924,超越前沿模型
- 适合需要高可靠性、低依赖人工指导的自动化视频编辑场景
实际视频编辑不仅涉及像素生成:编辑者需将简要说明、素材片段池、音乐元数据及硬约束转化为可执行时间线。本文将这一决策层定义为可执行视频编辑规划,并提出RefineCut,不同于传统工作流系统对提示驱动模型的封装,该方法训练一个紧凑的开放权重规划器。规划器通过结构化补丁完成片段选择、裁剪、排序、转场、时长与音乐对齐等操作;由确定性验证器逐个应用并检验补丁是否符合显式约束清单。因编辑无唯一真值修复方案,不直接模仿教师:RefineCut通过验证器回放多教师分支,保留验证器最优修复作为监督信号。第二阶段RefineCut-Evo让学生使用验证器和任务评分标准自评修复结果,基于高置信度偏好对进行训练,最终80亿参数规划器可在闭合验证器循环中运行,推理时不调用教师模型。在包含3,578项任务、7,971段带字幕片段、499首音乐曲目的RefineCut-Bench上,验证器重播蒸馏使规划器得分从0.620提升至0.858,而RefineCut-Evo达0.924;该提升迁移至Llama-3.1-8B和GLM-4-9B,在相同闭合循环中,80亿参数规划器达到或超越其前沿教师模型表现。代码与RefineCut-Bench已公开发布。
原文摘要 · Abstract (English)
Practical video editing is not only pixel generation: an editor must turn a brief, a clip pool, music metadata, and hard constraints into an executable timeline. We study this decision layer as \emph{executable video-editing planning} and introduce RefineCut, which, unlike workflow systems that wrap a prompted frontier model, trains a compact open-weight planner for it. The planner edits a typed timeline through structured patches covering clip selection, trimming, ordering, transitions, and duration and music alignment; a deterministic verifier applies each patch and checks it against an explicit constraint ledger. Because editing has no single ground-truth repair, we do not imitate teachers directly: RefineCut replays every multi-teacher branch through the verifier and keeps verifier-best repairs as supervision. A second stage, RefineCut-Evo, lets the student score its own repairs with the verifier and a task rubric and trains on high-margin preference pairs, so the final $8$B planner runs in a closed verifier loop with no teacher calls at inference. On RefineCut-Bench ($3{,}578$ tasks, $7{,}971$ captioned clips, $499$ music tracks, explicit ledgers), verifier-replayed distillation lifts the planner from $0.620$ to $0.858$ on the protocol-specific Video-Editing Score and RefineCut-Evo reaches $0.924$; the gain transfers to Llama-3.1-8B and GLM-4-9B, and in the same closed loop the $8$B planner matches or exceeds its frontier teachers. Code and RefineCut-Bench are publicly released; see the Data Availability statement.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。