通过自适应选图提升3D高斯点云建模完整性
Online 3D Gaussian Splatting Modeling with Novel View Selection
- 在线分析重建质量,动态选择最优非关键帧补充训练
- 融合关键帧与选中非关键帧,显著提升场景覆盖完整性
- 适合实时3D建模需求,尤其在复杂室外场景表现优异
本研究解决仅用RGB帧生成在线3D高斯点云(3DGS)模型的挑战。以往方法依赖密集SLAM技术从关键帧估计3D场景,但仅使用关键帧难以完整捕捉整个场景,导致重建不完整。构建泛化能力强的模型需引入多视角帧以扩大覆盖范围,但在线处理限制了大量帧或多次训练迭代的使用。为此,我们提出一种新方法,通过自适应视图选择提升3DGS建模质量。该方法在线分析重建质量,选取最优非关键帧进行额外训练。结合关键帧与所选非关键帧,可从多视角精修不完整区域,显著提升完整性。同时,我们构建一个集成在线多视图立体视觉的框架,确保3D信息在建模过程中的一致性。实验表明,该方法在复杂户外场景中优于现有最先进方法,表现出色。
原文摘要 · Abstract (English)
This study addresses the challenge of generating online 3D Gaussian Splatting (3DGS) models from RGB-only frames. Previous studies have employed dense SLAM techniques to estimate 3D scenes from keyframes for 3DGS model construction. However, these methods are limited by their reliance solely on keyframes, which are insufficient to capture an entire scene, resulting in incomplete reconstructions. Moreover, building a generalizable model requires incorporating frames from diverse viewpoints to achieve broader scene coverage. However, online processing restricts the use of many frames or extensive training iterations. Therefore, we propose a novel method for high-quality 3DGS modeling that improves model completeness through adaptive view selection. By analyzing reconstruction quality online, our approach selects optimal non-keyframes for additional training. By integrating both keyframes and selected non-keyframes, the method refines incomplete regions from diverse viewpoints, significantly enhancing completeness. We also present a framework that incorporates an online multi-view stereo approach, ensuring consistency in 3D information throughout the 3DGS modeling process. Experimental results demonstrate that our method outperforms state-of-the-art methods, delivering exceptional performance in complex outdoor scenes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。