STREAMINGGS优化3D高斯点云渲染，让手机秒开90帧。
STREAMINGGS: Voxel-Based Streaming 3D Gaussian Splatting with Memory Optimization and Architectural Support
- 从分块渲染转为内存优先，实现细粒度流水线
- 在移动端达45.7倍加速、62.9倍省电
- 适合移动设备上实时3D高斯点云应用
3D高斯点云（3DGS）因其高效性与稀疏表示广受欢迎。然而，3DGS在资源受限的移动设备上难以满足每秒90帧的实时要求，仅能达到2至9帧。现有加速器侧重计算效率，忽视内存效率，导致冗余的DRAM流量。我们提出STREAMINGGS，一种算法-架构协同设计的全流式3DGS方案，通过将渲染方式从分块为中心转为以内存为中心，实现细粒度流水线并减少DRAM流量。结果表明，该设计相较移动版Ampere GPU，最高实现45.7倍加速和62.9倍能效提升。
原文摘要 · Abstract (English)
3D Gaussian Splatting (3DGS) has gained popularity for its efficiency and sparse Gaussian-based representation. However, 3DGS struggles to meet the real-time requirement of 90 frames per second (FPS) on resource-constrained mobile devices, achieving only 2 to 9 FPS.Existing accelerators focus on compute efficiency but overlook memory efficiency, leading to redundant DRAM traffic. We introduce STREAMINGGS, a fully streaming 3DGS algorithm-architecture co-design that achieves fine-grained pipelining and reduces DRAM traffic by transforming from a tile-centric rendering to a memory-centric rendering. Results show that our design achieves up to 45.7 $\times$ speedup and 62.9 $\times$ energy savings over mobile Ampere GPUs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。