arXiv:2608.17389cs.CV2026-08

解决长视频3D重建中局部准确与全局一致的矛盾

GeoWeaver: Accurate Long-Sequence 3D Reconstruction via Hierarchical Geometric Assembly

论文配图:GeoWeaver: Accurate Long-Sequence 3D Reconstruction via Hierarchical Geometric Assembly
图 1 · 摘自论文原文
  • 分块预测+几何先验+测试时自适应,逐级修正误差
  • 在多个长序列数据集上显著提升相机精度与点云质量
  • 适用于多种深度模型,可作为通用后处理框架

从RGB视频进行长序列3D重建需兼顾局部几何精度与全局相机运动一致性。前馈模型虽能提供强深度和位姿预测,但内存开销限制了长序列联合推理。分块处理虽提升可扩展性,但独立预测的块常出现尺度漂移、位姿误差和点云错位。本文提出GeoWeaver,包含几何先验模型(GPM)与测试时自适应(TTA)。GPM输出分块深度、置信度及相机参数作为可调几何先验。TTA执行序列初始化、全局块级Sim(3)对齐,以及相机位姿、仿射深度修正和内参的粗到精优化。稠密对应关系提供相邻、跨块及远距离约束,鲁棒的CDF风格目标联合优化加权2D重投影与3D一致性残差。该设计在保持局部几何精度的同时,纠正累积的位姿、尺度、深度和标定误差。多基准测试验证其在相机精度、全局一致性与点云质量上的提升。消融实验确认各适配阶段贡献,且同一TTA流程应用于不同几何先验模型均改善轨迹估计,表明GeoWeaver不依赖特定GPM。

原文摘要 · Abstract (English)

Long-sequence 3D reconstruction from RGB videos requires both accurate local geometry and globally consistent camera motion. Feed-forward models provide strong depth and pose predictions, but their memory cost prevents joint inference over long sequences. Chunk-wise processing improves scalability, yet independently predicted chunks often exhibit scale drift, pose errors, and point-cloud misalignment. We present GeoWeaver, a unified framework comprising a Geometric Prior Model (GPM) and Test-Time Adaptation (TTA). The GPM predicts chunk-wise depth, confidence, and camera parameters as adjustable geometric priors. TTA then performs sequential initialization, global chunk-level Sim(3) alignment, and coarse-to-fine refinement of camera poses, affine depth corrections, and intrinsics. Dense correspondences provide adjacent, cross-chunk, and long-range constraints, while a robust CDF-style objective jointly optimizes weighted 2D reprojection and 3D consistency residuals. This design preserves local geometric accuracy while correcting accumulated pose, scale, depth, and calibration errors. Experiments across diverse long-sequence benchmarks demonstrate improved camera accuracy, global consistency, and point-cloud quality. Ablations verify the contribution of each adaptation stage, and applying the same TTA procedure to different geometric prior models consistently improves their trajectory estimates, demonstrating that GeoWeaver is not tied to a specific GPM.

3D重建几何先验测试时自适应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。