提出混合基方法,提升2D相机运动估计精度与稳定性。
CamFlow+: Hybrid Motion Bases for 2D Camera Motion Estimation with Stabilization Applications

- 融合物理基、随机基和深度位移基,突破单平面限制。
- 在GHOF-Cam数据集上显著提升稀疏与稠密运动估计性能。
- 适用于视频稳定化,用户盲测中首选率最优。
2D相机运动估计是计算机视觉与计算摄影的基础。现有基于单应性的方法在平面场景或纯旋转下表现良好,但在相机平移、深度变化和局部视差时表现不佳;局部单应性与网格模型虽更具灵活性,但仍依赖分段平面假设。本文提出CamFlow+,一种直接在稠密光流空间中表示2D相机运动的混合基框架。该方法结合由单应性导出的物理基、从单应性流中采样的随机基,以及由深度和相机内参推导的深度-位移基,放松了单平面约束的同时保持相机运动规律性。引入深度感知平滑项,进一步在连续深度区域正则化由平移引起的视差,同时保留深度边界附近的运动变化。我们在GHOF-Cam数据集上进行评估,该数据集通过遮蔽动态物体与病态遮挡区域,从光学流基准中分离出仅由相机运动引起的部分。实验表明,CamFlow+在稀疏与稠密相机运动估计上均有提升。在数字视频稳定化任务中,其在全局与局部稳定性上均优于现有方法,在盲用户测试中获得最高首选率。代码与数据集将发布于项目主页:https://lhaippp.github.io/CamFlow+。
原文摘要 · Abstract (English)
Estimating 2D camera motion is fundamental to computer vision and computational photography. Existing homography-based methods work well for planar scenes or pure rotation, but struggle with camera translation, depth variation, and local parallax; local homography and mesh-based models improve flexibility but still rely on piecewise planar assumptions. We introduce CamFlow+, a hybrid-basis framework that represents 2D camera motion directly in dense-flow space. CamFlow+ combines homography-derived physical bases, stochastic bases sampled from homography flows, and depth-translational bases derived from depth and camera intrinsics, relaxing the single-plane constraint while preserving camera-motion regularity. A depth-aware smoothness term further regularizes translation-induced parallax in continuous-depth regions while preserving motion changes near depth boundaries. We evaluate CamFlow+ on GHOF-Cam, a camera-motion benchmark that masks out dynamic objects and ill-posed occlusion regions in an optical-flow benchmark to isolate camera-induced motion. Experiments show that CamFlow+ improves sparse and dense camera-motion estimation. In digital video stabilization, CamFlow+ also improves global and local stability, achieving the best top-1 preference rate in a blind user study. Code and datasets will be available on the project page: https://lhaippp.github.io/CamFlow+.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。