让视频生成精准控制运动轨迹,无需修改模型结构。
Wan-Move: Motion-controllable Video Generation via Latent Trajectory Guidance
- 用密集点轨迹表示运动,在隐空间传播特征实现精细控制。
- 生成5秒480p视频,运动控制效果媲美商业工具Kling 1.5 Pro。
- 支持无修改接入现有模型,适合需要灵活运动控制的研究者。
我们提出Wan-Move,一个简单且可扩展的框架,为视频生成模型引入运动控制能力。现有方法通常控制粒度粗、可扩展性差,难以实用。Wan-Move通过将原始条件特征变为运动感知,实现高精度运动控制。核心思路是用密集点轨迹表示物体运动,将轨迹投影到隐空间,并沿每条轨迹传播首帧特征,生成对齐的时空特征图,指导场景元素运动。该特征图作为更新后的隐条件,直接集成到现成的图像转视频模型(如Wan-I2V-14B)中,无需架构修改,避免额外运动编码器,且易于扩展。经规模化训练,Wan-Move可生成5秒480p视频,用户研究显示其运动控制能力媲美商业工具Kling 1.5 Pro。为支持全面评估,我们设计了MoveBench基准,包含多样化内容类别和混合验证标注,数据量大、视频时长更长、运动标注高质量。在MoveBench及公开数据集上的实验一致表明,Wan-Move在运动质量上表现更优。代码、模型与基准数据均已开源。
原文摘要 · Abstract (English)
We present Wan-Move, a simple and scalable framework that brings motion control to video generative models. Existing motion-controllable methods typically suffer from coarse control granularity and limited scalability, leaving their outputs insufficient for practical use. We narrow this gap by achieving precise and high-quality motion control. Our core idea is to directly make the original condition features motion-aware for guiding video synthesis. To this end, we first represent object motions with dense point trajectories, allowing fine-grained control over the scene. We then project these trajectories into latent space and propagate the first frame's features along each trajectory, producing an aligned spatiotemporal feature map that tells how each scene element should move. This feature map serves as the updated latent condition, which is naturally integrated into the off-the-shelf image-to-video model, e.g., Wan-I2V-14B, as motion guidance without any architecture change. It removes the need for auxiliary motion encoders and makes fine-tuning base models easily scalable. Through scaled training, Wan-Move generates 5-second, 480p videos whose motion controllability rivals Kling 1.5 Pro's commercial Motion Brush, as indicated by user studies. To support comprehensive evaluation, we further design MoveBench, a rigorously curated benchmark featuring diverse content categories and hybrid-verified annotations. It is distinguished by larger data volume, longer video durations, and high-quality motion annotations. Extensive experiments on MoveBench and the public dataset consistently show Wan-Move's superior motion quality. Code, models, and benchmark data are made publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。