让视频镜头控制更精准,还能调节主体运动强度。
I2VControl-Camera: Precise Video Camera Control with Adjustable Motion Strength

- 用相机坐标系中的点轨迹代替传统参数,提升控制精度。
- 建模运动轨迹高阶成分,实现对动作幅度的可调控制。
- 适配任意基础模型,适合需要精细镜头调度的生成任务。
视频生成技术快速发展,镜头控制对生成专业级视频至关重要。现有方法在控制精度和主体运动动态建模上仍有不足。本文提出I2VControl-Camera,通过相机坐标系中的点轨迹作为控制信号,替代仅依赖外参矩阵的方式,显著提升控制精度。同时,显式建模视频轨迹的高阶分量,设计运算符以灵活调节主体运动强度。采用与基础模型结构无关的适配器架构。在静态与动态场景上的实验表明,该方法在定量和定性指标上均优于现有方法。
原文摘要 · Abstract (English)
Video generation technologies are developing rapidly and have broad potential applications. Among these technologies, camera control is crucial for generating professional-quality videos that accurately meet user expectations. However, existing camera control methods still suffer from several limitations, including control precision and the neglect of the control for subject motion dynamics. In this work, we propose I2VControl-Camera, a novel camera control method that significantly enhances controllability while providing adjustability over the strength of subject motion. To improve control precision, we employ point trajectory in the camera coordinate system instead of only extrinsic matrix information as our control signal. To accurately control and adjust the strength of subject motion, we explicitly model the higher-order components of the video trajectory expansion, not merely the linear terms, and design an operator that effectively represents the motion strength. We use an adapter architecture that is independent of the base model structure. Experiments on static and dynamic scenes show that our framework outperformances previous methods both quantitatively and qualitatively. The project page is: https://wanquanf.github.io/I2VControlCamera .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。