让视频镜头运动按真实尺度迁移,解决大小场景不匹配问题
ParaScale: Scale-Calibrated Camera-Motion Transfer via a Gauge-Invariant Parallax Number

- 用无量纲的视差数统一衡量镜头运动强度
- 在跨度四阶的尺度下保持运动感知一致,误差降低3倍以上
- 无需重训练,可嵌入任意生成模型,适合影视制作与动画创作
将参考视频的镜头运动迁移到新生成视频中,能让创作者复用电影级运镜。但参考与目标场景常存在尺度差异——如跨星系的横移与桌面微动——直接复用轨迹会导致运动过弱或过猛。根源在于:单目相机的平移运动在图像上缩放比例为 ||T||/Z,因此仅靠原始轨迹无法保证尺度一致性。本文提出视差数 Pi = ||ΔT|| / Z̄,一个无量纲、对深度尺度不变的运动感知度量,并证明只有它才应被迁移以实现真实尺度还原。ParaScale 模块可从任一参考视频提取 Pi,再根据目标场景每帧深度重新实现运动,保留旋转分量。该模块无需重训练,可插件式接入任意姿态条件生成器。我们进一步设计了尺度对称的视差一致性误差(PCE),相比传统相似性对齐的TransErr,能更准确暴露尺度错配。在跨越四个数量级的尺度范围和多种骨干网络下,ParaScale 始终使实现的视差逼近理想直线,且将 PCE 降低 3 倍以上,同时视觉保真度不受损失。
原文摘要 · Abstract (English)
Transferring the camera motion of a reference video to a freshly generated one lets creators reuse cinematic moves. Yet reference and target often live at incompatible scales -- a sweep across a galaxy versus a nudge across a desk -- and naively reusing the recovered trajectory yields either imperceptible or violently exaggerated motion. We trace this to a geometric fact: translation-induced image motion scales as ||T||/Z, so a monocular trajectory is meaningful only up to a depth-scale gauge. We distill this into the Parallax Number Pi = ||Delta T|| / Zbar, a dimensionless, gauge-invariant descriptor of how strongly a camera move is felt, and prove that it -- not the raw trajectory -- is the quantity that scale-faithful transfer must preserve. ParaScale is a plug-and-play module that reads Pi off any reference video and re-realizes it against the target scene's own depth, per frame, leaving rotation untouched. Sitting between pose extraction and pose injection, it requires no retraining and drops into any pose-conditioned generator. We further introduce the Parallax Consistency Error (PCE), a scale-symmetric metric that -- unlike the similarity-aligned TransErr -- exposes scene-scale mismatch. Across scale regimes spanning four orders of magnitude and multiple backbones, ParaScale keeps the realized parallax on the identity line and cuts PCE by more than 3x over uncalibrated transfer with no loss of visual fidelity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。