arXiv:2508.18540cs.GReess.IV2025-08被引 1

实现光场显示下辐射场的实时渲染,速度提升22倍。

Real-time 3D Visualization of Radiance Fields on Light Field Displays

  • 将辐射场转为共享平面,单次合成所有视角光场图像。
  • 在512p分辨率下实现45视角、200+帧/秒的流畅交互。
  • 兼容多种场景表示,适合高沉浸感3D应用开发。

辐射场(包括3D高斯点云和稀疏体素等高效形式)通过高保真重建复杂环境,天然适配光场显示。但二者结合面临巨大计算挑战:光场显示需从微小偏移视角生成大量高分辨率图像,而辐射场依赖计算密集的体素渲染,难以实现实时。本文提出统一高效的光场显示辐射场实时渲染框架。不独立重渲染每个视角,而是将输入辐射场转换为可共享的中间扫掠平面,单次合成所有密集光场视图。方法优先使用共享、非方向性平面缓存以保证实时性能,仅小幅增加中间内存开销,牺牲部分视角依赖颜色细节。框架无需重新训练即可泛化至不同场景表示,避免视角间重复计算。我们在Looking Glass显示设备上实现实时交互应用,在512p分辨率下达成45个视图200+帧/秒的性能,并在标准基准测试中实现最高22倍的速度提升,同时基本保持图像质量。

原文摘要 · Abstract (English)

Radiance fields, including their recent efficient forms such as 3D Gaussian Splatting and Sparse Voxels, have revolutionized photorealistic 3D scene visualization by enabling high-fidelity reconstruction of complex environments, making them a natural match for light field displays. However, integrating these technologies presents significant computational challenges, as light field displays require many high-resolution renderings from slightly shifted viewpoints, while radiance fields rely on computationally intensive volume rendering, which is intractable to achieve real-time speeds even with efficient scene representations. In this paper, we propose a unified and efficient framework for real-time radiance field rendering on light field displays. Rather than re-rendering each view independently, our method converts the input radiance field into shared intermediate sweeping planes that can be efficiently composited into dense light-field views in a single pass. Our method prioritizes shared, non-directional plane caching for real-time performance, trading fine view-dependent color effects for a modest increase in intermediate memory usage. Our framework generalizes across different scene representations without retraining and avoids repeated computation across views. We further demonstrate a real-time interactive application on a Looking Glass display, achieving 200+ FPS at 512p across 45 rendered views and enabling seamless, immersive 3D interactive viewing experiences. On standard benchmarks, our method achieves up to 22x speedup compared to independently rendering each view, while largely preserving image quality.

光场显示辐射场实时渲染3D可视化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。