融合显式粗网格与隐式残差细节,实现高效高质大规模在线重建。
RemixFusion: Residual-based Mixed Representation for Large-scale Online RGB-D Reconstruction
- 用显式粗网格+隐式残差模块混合表示场景,兼顾细节与效率。
- 在大型场景上实现更精确的建图与位姿追踪,优于现有方法。
- 适合需要实时高精度重建的机器人、AR/VR应用。
神经隐式表示显著推动了在线稠密重建技术的发展。相比传统显式表示(如TSDF),它提升了映射完整性并降低内存消耗。然而,细节缺失和神经表示学习耗时问题限制了其在大规模在线重建中的应用。本文提出RemixFusion,一种基于残差的混合表示方法,用于高质量、大规模在线RGB-D重建。该方法采用显式粗粒度TSDF网格与隐式神经模块结合,后者生成需叠加到粗网格上的细粒度残差。这种混合表示在有限时间与内存预算下实现丰富细节重建,克服纯隐式方法过度平滑的问题,提升相机跟踪质量。进一步地,通过束光束优化(BA)实现多帧联合位姿优化,不直接优化位姿,而是优化位姿变化,并结合自适应梯度放大技术,提升收敛性与全局最优性。同时,采用局部移动体积分解混合表示,以分治设计支持高效在线学习。大量实验表明,本方法在大规模场景的建图与追踪精度上超越所有现有先进方法,无论基于显式或隐式表示。
原文摘要 · Abstract (English)
The introduction of the neural implicit representation has notably propelled the advancement of online dense reconstruction techniques. Compared to traditional explicit representations, such as TSDF, it improves the mapping completeness and memory efficiency. However, the lack of reconstruction details and the time-consuming learning of neural representations hinder the widespread application of neural-based methods to large-scale online reconstruction. We introduce RemixFusion, a novel residual-based mixed representation for scene reconstruction and camera pose estimation dedicated to high-quality and large-scale online RGB-D reconstruction. In particular, we propose a residual-based map representation comprised of an explicit coarse TSDF grid and an implicit neural module that produces residuals representing fine-grained details to be added to the coarse grid. Such mixed representation allows for detail-rich reconstruction with bounded time and memory budget, contrasting with the overly-smoothed results by the purely implicit representations, thus paving the way for high-quality camera tracking. Furthermore, we extend the residual-based representation to handle multi-frame joint pose optimization via bundle adjustment (BA). In contrast to the existing methods, which optimize poses directly, we opt to optimize pose changes. Combined with a novel technique for adaptive gradient amplification, our method attains better optimization convergence and global optimality. Furthermore, we adopt a local moving volume to factorize the mixed scene representation with a divide-and-conquer design to facilitate efficient online learning in our residual-based framework. Extensive experiments demonstrate that our method surpasses all state-of-the-art ones, including those based either on explicit or implicit representations, in terms of the accuracy of both mapping and tracking on large-scale scenes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。