arXiv:2604.03723cs.CV2026-04被引 3

统一控制镜头运动与物体动态,生成更连贯的视频。

SymphoMotion: Joint Control of Camera Motion and Object Dynamics for Coherent Video Generation

论文配图:SymphoMotion: Joint Control of Camera Motion and Object Dynamics for Coherent Video Generation
图 1 · 摘自论文原文
  • 用显式镜头路径和3D几何线索联合控制镜头轨迹
  • 在真实数据集上实现高精度物体运动与镜头控制
  • 适合需要精细镜头与物体协同控制的视频生成任务

同时控制镜头运动与物体动态对生成连贯且富有表现力的视频至关重要,但现有方法通常仅处理单一运动类型,或依赖模糊的2D线索,导致镜头视差与真实物体运动混淆。本文提出SymphoMotion,一个统一的运动控制框架,通过单一模型联合调控镜头轨迹与物体动态。其镜头轨迹控制机制结合显式镜头路径与几何感知线索,确保视角转换稳定且结构一致;物体动态控制机制融合2D视觉引导与3D轨迹嵌入,实现深度感知、空间连贯的物体操控。为支持大规模训练与评估,我们构建了RealCOD-25K,一个包含25,000组真实场景下镜头位姿与物体级3D轨迹的综合数据集,填补了统一运动控制的数据空白。大量实验与用户研究显示,SymphoMotion在视觉保真度、镜头可控性与物体运动准确性上显著优于现有方法,确立了视频生成中统一运动控制的新基准。代码与数据公开于https://grenoble-zhang.github.io/SymphoMotion/。

原文摘要 · Abstract (English)

Controlling both camera motion and object dynamics is essential for coherent and expressive video generation, yet current methods typically handle only one motion type or rely on ambiguous 2D cues that entangle camera-induced parallax with true object movement. We present SymphoMotion, a unified motion-control framework that jointly governs camera trajectories and object dynamics within a single model. SymphoMotion features a Camera Trajectory Control mechanism that integrates explicit camera paths with geometry-aware cues to ensure stable, structurally consistent viewpoint transitions, and an Object Dynamics Control mechanism that combines 2D visual guidance with 3D trajectory embeddings to enable depth-aware, spatially coherent object manipulation. To support large-scale training and evaluation, we further construct RealCOD-25K, a comprehensive real-world dataset containing paired camera poses and object-level 3D trajectories across diverse indoor and outdoor scenes, addressing a key data gap in unified motion control. Extensive experiments and user studies show that SymphoMotion significantly outperforms existing methods in visual fidelity, camera controllability, and object-motion accuracy, establishing a new benchmark for unified motion control in video generation. Codes and data are publicly available at https://grenoble-zhang.github.io/SymphoMotion/.

视频生成运动控制3D轨迹镜头运动

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。