通过分层高斯点云实现高效3D场景传输,显著降低带宽占用。
L3GS: Layered 3D Gaussian Splats for Efficient 3D Scene Delivery
- 将3D高斯点云分层组织,支持渐进式下载与渲染
- 实测平均SSIM提升16.9%,比基线更清晰
- 适合虚拟现实等低延迟高画质场景应用
传统3D内容表示如密集点云数据量大,而神经辐射场因非标准体素渲染导致帧率低下。3D高斯点云(3DGS)兼具高视觉质量与实时渲染效率,但其传输仍面临挑战,单个场景可达1.5 GB。本文提出面向高效交付的分层3D高斯点云系统(L3GS),通过构建分层3DGS场景、设计动态下载调度算法,并基于佩戴虚拟现实头显用户的追踪数据进行评估。实验表明,该系统在保持高视觉质量的同时显著降低网络负载,相较基线平均SSIM提升16.9%,且兼容其他压缩形式的3DGS表示。
原文摘要 · Abstract (English)
Traditional 3D content representations include dense point clouds that consume large amounts of data and hence network bandwidth, while newer representations such as neural radiance fields suffer from poor frame rates due to their non-standard volumetric rendering pipeline. 3D Gaussian splats (3DGS) can be seen as a generalization of point clouds that meet the best of both worlds, with high visual quality and efficient rendering for real-time frame rates. However, delivering 3DGS scenes from a hosting server to client devices is still challenging due to high network data consumption (e.g., 1.5 GB for a single scene). The goal of this work is to create an efficient 3D content delivery framework that allows users to view high quality 3D scenes with 3DGS as the underlying data representation. The main contributions of the paper are: (1) Creating new layered 3DGS scenes for efficient delivery, (2) Scheduling algorithms to choose what splats to download at what time, and (3) Trace-driven experiments from users wearing virtual reality headsets to evaluate the visual quality and latency. Our system for Layered 3D Gaussian Splats delivery L3GS demonstrates high visual quality, achieving 16.9% higher average SSIM compared to baselines, and also works with other compressed 3DGS representations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。