用对抗训练提升视频扩散模型的运动质量,无需人工评分。
MoGAN: Improving Motion Quality in Video Diffusion via Few-Step Motion Adversarial Post-Training
- 在3步蒸馏模型上训练光流判别器,聚焦运动真实性。
- 在VBench和VideoJAM-Bench上运动评分提升超7%,视觉质量不降。
- 适合追求快速生成且运动自然的视频生成应用。
视频扩散模型在帧级保真度上表现强劲,但在运动连贯性、动态真实性和流畅性方面仍存在抖动、鬼影或不合理运动等问题。主要原因是标准去噪MSE目标函数缺乏对时间一致性的直接监督,导致模型可获得低损失却生成劣质运动。本文提出MoGAN,一种以运动为中心的后训练框架,无需奖励模型或人类偏好数据即可提升运动真实性。基于3步蒸馏的视频扩散模型,训练一个基于DiT的光流判别器以区分真实与生成运动,并引入分布匹配正则项保持视觉保真度。在Wan2.1-T2V-1.3B上的实验表明,MoGAN显著提升运动质量:在VBench上相比50步教师模型提升+7.3%,相比3步DMD模型提升+13.3%;在VideoJAM-Bench上分别提升+7.4%和+8.8%,同时保持甚至优于原模型的美学与图像质量。人类评估进一步验证,MoGAN在运动质量上更受青睐(52%对比教师的38%,56%对比DMD的29%)。整体上,MoGAN在不牺牲视觉质量与效率的前提下,大幅增强运动真实性,为高效高质量视频生成提供可行路径。
原文摘要 · Abstract (English)
Video diffusion models achieve strong frame-level fidelity but still struggle with motion coherence, dynamics and realism, often producing jitter, ghosting, or implausible dynamics. A key limitation is that the standard denoising MSE objective provides no direct supervision on temporal consistency, allowing models to achieve low loss while still generating poor motion. We propose MoGAN, a motion-centric post-training framework that improves motion realism without reward models or human preference data. Built atop a 3-step distilled video diffusion model, we train a DiT-based optical-flow discriminator to differentiate real from generated motion, combined with a distribution-matching regularizer to preserve visual fidelity. With experiments on Wan2.1-T2V-1.3B, MoGAN substantially improves motion quality across benchmarks. On VBench, MoGAN boosts motion score by +7.3% over the 50-step teacher and +13.3% over the 3-step DMD model. On VideoJAM-Bench, MoGAN improves motion score by +7.4% over the teacher and +8.8% over DMD, while maintaining comparable or even better aesthetic and image-quality scores. A human study further confirms that MoGAN is preferred for motion quality (52% vs. 38% for the teacher; 56% vs. 29% for DMD). Overall, MoGAN delivers significantly more realistic motion without sacrificing visual fidelity or efficiency, offering a practical path toward fast, high-quality video generation. Project webpage is: https://xavihart.github.io/mogan.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。