arXiv:2606.03911cs.CV2026-06中稿 · ICML

无需成对数据,用生成模型自建训练信号实现高效图像视频编辑

Bootstrap Your Generator: Unpaired Visual Editing with Flow Matching

论文配图:Bootstrap Your Generator: Unpaired Visual Editing with Flow Matching
图 1 · 摘自论文原文
  • 从冻结模型中提取指令跟随线索,结合循环一致性保持结构
  • 梯度路由使噪声训练状态可优化,实现端到端无监督训练
  • 在数据稀缺场景下效果超越百万样本监督模型,适合跨域应用

现代生成模型具备深层视觉理解能力,但图像编辑训练通常依赖海量成对数据,难以扩展,尤其视频编辑因收集成对数据成本过高而受限。本文提出通用框架 Bootstrap Your Generator(ByG),实现流匹配编辑模型的无配对训练。该方法利用基础模型知识,无需外部信号,通过从冻结模型中提取指令跟随线索,并结合循环一致性来保持结构。为使训练可行,我们提出将下游损失的梯度从干净预测路由至噪声训练状态。在数据稀缺的图像与视频编辑任务上,本方法达到领先性能。大量评估与用户研究显示,该方法能有效泛化至未见领域,优于基于数百万样本训练的监督基线。分析表明,梯度路由弥合了训练-推理差距,且从基础模型中提取语义线索提供了稳定训练信号,无需外部奖励模型。

原文摘要 · Abstract (English)

Modern generative models possess a deep understanding of visual content, yet training them for image editing typically requires massive datasets of paired examples. This limits scalability, especially for video editing where collecting paired data is prohibitively expensive. We propose Bootstrap Your Generator (ByG), a general framework for unpaired training of flow matching editing models. It leverages the base model's knowledge without any external signal. Our approach pairs instruction-following cues extracted from the frozen model with cycle-consistency for structure preservation. To make this tractable, we propose to route gradients from downstream losses over clean predictions to noisy training states. We demonstrate state-of-the-art results on challenging data-scarce image and video editing scenarios. Extensive evaluations and user studies show that our method effectively generalizes to unseen domains and outperforms supervised baselines trained on millions of samples. Analysis reveals that our gradient routing bridges the train-inference gap, and extracting semantic cues from a base model provides a robust training signal that obviates the need for external reward models.

图像编辑无监督学习流匹配视频生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。