Radiant通过分层框架实现大规模3D高斯渲染,提升重建质量并降低延迟。
Radiant: Large-scale 3D Gaussian Rendering based on Hierarchical Framework
- 基于系统异构性分区域分配任务,优化边缘设备负载
- 重建质量最高提升25.7%,端到端延迟降低79.6%
- 适合大规模分布式3D场景重建,兼顾效率与隐私
随着计算机视觉的发展,最近兴起的3D高斯点阵(3DGS)因其优异性能成为主流场景重建算法。分布式3DGS可利用边缘设备直接在采集图像上训练,减轻计算负担并提高效率。然而,传统分布式框架常忽视真实环境中的计算与通信挑战,阻碍大规模部署并可能引发隐私风险。本文提出Radiant,一种面向大规模场景重建的分层3DGS算法,考虑系统异构性,提升模型性能与训练效率。通过大量实证研究发现,合理划分每个边缘设备的区域并差异化分配相机位置对图像采集与训练至关重要。Radiant的核心在于根据异构环境信息分区,并相应分配工作负载。此外,提出一种3DGS模型聚合算法,提升模型质量并保证边界连续性。最后构建测试平台,实验表明Radiant将重建质量最高提升25.7%,端到端延迟最多降低79.6%。
原文摘要 · Abstract (English)
With the advancement of computer vision, the recently emerged 3D Gaussian Splatting (3DGS) has increasingly become a popular scene reconstruction algorithm due to its outstanding performance. Distributed 3DGS can efficiently utilize edge devices to directly train on the collected images, thereby offloading computational demands and enhancing efficiency. However, traditional distributed frameworks often overlook computational and communication challenges in real-world environments, hindering large-scale deployment and potentially posing privacy risks. In this paper, we propose Radiant, a hierarchical 3DGS algorithm designed for large-scale scene reconstruction that considers system heterogeneity, enhancing the model performance and training efficiency. Via extensive empirical study, we find that it is crucial to partition the regions for each edge appropriately and allocate varying camera positions to each device for image collection and training. The core of Radiant is partitioning regions based on heterogeneous environment information and allocating workloads to each device accordingly. Furthermore, we provide a 3DGS model aggregation algorithm that enhances the quality and ensures the continuity of models' boundaries. Finally, we develop a testbed, and experiments demonstrate that Radiant improved reconstruction quality by up to 25.7\% and reduced up to 79.6\% end-to-end latency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。