用分布式方法实现稀疏视角下快速高质量大场景重建
DGTR: Distributed Gaussian Turbo-Reconstruction for Sparse-View Vast Scenes
- 将场景分块由无人机独立处理,结合前馈高斯模型生成高质量点云
- 训练时间大幅缩短,分钟级完成大场景重建,效果优于现有方法
- 适合资源受限的无人机巡检等实时大场景应用
新颖视图合成(NVS)在大场景重建中至关重要,但现有方法依赖密集图像输入和长时间训练,资源受限场景难以适用。少数样本方法在大场景中常出现重建质量差的问题。本文提出DGTR,一种用于稀疏视角大场景的分布式高斯重建框架。通过将场景划分为区域,由携带稀疏图像输入的无人机独立处理;采用前馈高斯模型预测高质量高斯基元,并利用全局对齐算法保证几何一致性。引入合成视图与深度先验增强训练,结合基于知识蒸馏的模型聚合机制实现高效重建。该方法在显著缩短训练时间的同时,实现了高质量的大规模场景重建与新颖视图合成,在多个空中大场景数据集上均取得领先性能,可在数分钟内完成重建。代码将发布于 https://3d-aigc.github.io/DGTR。
原文摘要 · Abstract (English)
Novel-view synthesis (NVS) approaches play a critical role in vast scene reconstruction. However, these methods rely heavily on dense image inputs and prolonged training times, making them unsuitable where computational resources are limited. Additionally, few-shot methods often struggle with poor reconstruction quality in vast environments. This paper presents DGTR, a novel distributed framework for efficient Gaussian reconstruction for sparse-view vast scenes. Our approach divides the scene into regions, processed independently by drones with sparse image inputs. Using a feed-forward Gaussian model, we predict high-quality Gaussian primitives, followed by a global alignment algorithm to ensure geometric consistency. Synthetic views and depth priors are incorporated to further enhance training, while a distillation-based model aggregation mechanism enables efficient reconstruction. Our method achieves high-quality large-scale scene reconstruction and novel-view synthesis in significantly reduced training times, outperforming existing approaches in both speed and scalability. We demonstrate the effectiveness of our framework on vast aerial scenes, achieving high-quality results within minutes. Code will released on our [https://3d-aigc.github.io/DGTR].
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。