提出视觉锐度一致的凝视渲染,实现在视网膜分辨率下高效保质渲染。
Visual Acuity Consistent Foveated Rendering towards Retinal Resolution
- 基于人眼视觉锐度模型设计对数极坐标映射,匹配视觉系统带宽。
- 在视网膜分辨率下实现6.5×至16.4×的渲染加速,帧率更流畅。
- 适用于高分辨率头显的双目渲染,适合虚拟现实与路径追踪场景。
现有凝视渲染方法在显示分辨率提升时面临着色负载激增的问题,导致效率下降,尤其在视网膜级分辨率下更为显著。为此,我们从人类视觉系统(HVS)感知本质出发,提出视觉锐度一致的凝视渲染(VaFR),旨在实现视网膜级分辨率下的卓越渲染性能。具体而言,我们设计了一种基于人眼视觉锐度模型的新对数极坐标映射函数,可适配视觉系统的自然带宽。该映射函数及其对应的着色率能确保无论虚拟现实头显显示分辨率如何变化,输出的渲染信息保持一致。因此,我们的VaFR在保留感知视觉质量的同时,显著提升渲染速度,尤其在视网膜分辨率下表现优异。我们在光栅化与光线投射渲染管道中验证了该方法,并测试了不同双目渲染策略。在多种测试场景中,相比以往方法,我们的方案不仅提供更佳的感知视觉质量,还实现了6.5×–9.29×的延迟渲染加速,以及在视网膜分辨率下高达10.4×–16.4×的光线投射加速。此外,该方法显著提升了8K双目路径追踪的渲染性能,实现流畅帧率。
原文摘要 · Abstract (English)
Prior foveated rendering methods often suffer from a limitation where the shading load escalates with increasing display resolution, leading to decreased efficiency, particularly when dealing with retinal-level resolutions. To tackle this challenge, we begin with the essence of the human visual system (HVS) perception and present visual acuity-consistent foveated rendering (VaFR), aiming to achieve exceptional rendering performance at retinal-level resolutions. Specifically, we propose a method with a novel log-polar mapping function derived from the human visual acuity model, which accommodates the natural bandwidth of the visual system. This mapping function and its associated shading rate guarantee a consistent output of rendering information, regardless of variations in the display resolution of the VR HMD. Consequently, our VaFR outperforms alternative methods, improving rendering speed while preserving perceptual visual quality, particularly when operating at retinal resolutions. We validate our approach using both the rasterization and ray-casting rendering pipelines. We also validate our approach using different binocular rendering strategies for HMD devices. In diverse testing scenarios, our approach delivers better perceptual visual quality than prior foveated rendering while achieving an impressive speedup of 6.5$\times$-9.29$\times$ for deferred rendering of 3D scenarios and an even more powerful speedup of 10.4$\times$-16.4$\times$ for ray-casting at retinal resolution. Additionally, our approach significantly enhances the rendering performance of binocular 8K path tracing, achieving smooth frame rates.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。