arXiv:2603.26665cs.CV2026-03

利用物体运动生成虚拟视角,实现稀疏摄像头下的高精度三维重建。

Detailed Geometry and Appearance from Opportunistic Motion

  • 通过物体运动构造虚拟观测视角,联合优化姿态与形状。
  • 在极稀疏视角下,几何与外观重建精度显著优于现有方法。
  • 适合需要低硬件成本三维重建的场景,如智能家具、工业检测。

从少量固定摄像头中重建三维几何与外观是一项基础任务,但受限于视角稀少。本文提出利用物体运动带来的机会性视角:当人操作物体(如移动椅子或举起杯子)时,静态摄像头在物体局部坐标系中相当于“环绕”观察,形成额外虚拟视角。为此,我们构建了联合姿态与形状优化框架,采用2D高斯点阵并交替优化6自由度轨迹与几何参数;同时引入新外观模型,将漫反射与镜面反射成分分解,并在球谐函数空间内进行方向性反射探测。在合成与真实数据集上的大量实验表明,该方法在极端稀疏视角下,显著提升了几何与外观重建精度,优于当前最优基准。

原文摘要 · Abstract (English)

Reconstructing 3D geometry and appearance from a sparse set of fixed cameras is a foundational task with broad applications, yet it remains fundamentally constrained by the limited viewpoints. We show that this bound can be broken by exploiting opportunistic object motion: as a person manipulates an object~(e.g., moving a chair or lifting a mug), the static cameras effectively ``orbit'' the object in its local coordinate frame, providing additional virtual viewpoints. Harnessing this object motion, however, poses two challenges: the tight coupling of object pose and geometry estimation and the complex appearance variations of a moving object under static illumination. We address these by formulating a joint pose and shape optimization using 2D Gaussian splatting with alternating minimization of 6DoF trajectories and primitive parameters, and by introducing a novel appearance model that factorizes diffuse and specular components with reflected directional probing within the spherical harmonics space. Extensive experiments on synthetic and real-world datasets with extremely sparse viewpoints demonstrate that our method recovers significantly more accurate geometry and appearance than state-of-the-art baselines.

三维重建几何建模运动感知虚拟视角

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。