FreeSplat++高效重建大场景室内3D,速度快且精度高。
FreeSplat++: Generalizable 3D Gaussian Splatting for Efficient Indoor Scene Reconstruction
- 用轻量跨视图聚合处理长序列输入,提升效率
- 像素级三元融合减少冗余点云,优化结构
- 深度正则化微调提升质量,适合大规模重建
近期研究将高效前馈机制引入3D高斯泼溅(3DGS),但多数方法仅适用于小范围稀疏视角重建,难以实现高质量、高效率的大规模室内全场景重建。本文提出FreeSplat++,旨在将可泛化的3DGS扩展为大场景室内重建的替代方案,显著提升重建速度并改善几何精度。首先提出低成本跨视图聚合框架,高效处理极长输入序列;其次设计像素级三元融合方法,增量聚合多视角重叠的3D高斯原语,自适应降低冗余;进一步提出加权浮点物移除策略,作为显式深度融合手段,有效减少伪影。在前馈重建后,引入基于深度正则化的场景级微调过程,利用前馈阶段获得的稠密多视图一致深度图作为额外约束,优化整个场景的3DGS原语,提升渲染质量同时保持几何准确性。大量实验表明,FreeSplat++显著优于现有可泛化3DGS方法,尤其在全场景重建中表现突出;相比传统逐场景优化的3DGS,本方法在重建精度上大幅提升,训练时间明显缩短。
原文摘要 · Abstract (English)
Recently, the integration of the efficient feed-forward scheme into 3D Gaussian Splatting (3DGS) has been actively explored. However, most existing methods focus on sparse view reconstruction of small regions and cannot produce eligible whole-scene reconstruction results in terms of either quality or efficiency. In this paper, we propose FreeSplat++, which focuses on extending the generalizable 3DGS to become an alternative approach to large-scale indoor whole-scene reconstruction, which has the potential of significantly accelerating the reconstruction speed and improving the geometric accuracy. To facilitate whole-scene reconstruction, we initially propose the Low-cost Cross-View Aggregation framework to efficiently process extremely long input sequences. Subsequently, we introduce a carefully designed pixel-wise triplet fusion method to incrementally aggregate the overlapping 3D Gaussian primitives from multiple views, adaptively reducing their redundancy. Furthermore, we propose a weighted floater removal strategy that can effectively reduce floaters, which serves as an explicit depth fusion approach that is crucial in whole-scene reconstruction. After the feed-forward reconstruction of 3DGS primitives, we investigate a depth-regularized per-scene fine-tuning process. Leveraging the dense, multi-view consistent depth maps obtained during the feed-forward prediction phase for an extra constraint, we refine the entire scene's 3DGS primitive to enhance rendering quality while preserving geometric accuracy. Extensive experiments confirm that our FreeSplat++ significantly outperforms existing generalizable 3DGS methods, especially in whole-scene reconstructions. Compared to conventional per-scene optimized 3DGS approaches, our method with depth-regularized per-scene fine-tuning demonstrates substantial improvements in reconstruction accuracy and a notable reduction in training time.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。