针对神经视图合成场景,提出首个无参考质量评估方法。
NeRF-NQA: No-Reference Quality Assessment for Scenes Generated by NeRF and Neural View Synthesis Methods
- 结合视图级与点级评估,全面衡量合成画面质量
- 在23种主流方法中显著优于现有技术
- 适合无真实参照的神经渲染质量评测
神经视图合成(NVS)已能通过稀疏视角图像生成高保真密集视角视频。然而,现有质量评估方法如PSNR、SSIM和LPIPS并不适用于由NVS和NeRF变体生成的密集视角场景,难以捕捉空间与视角感知质量。此外,由于缺乏密集真实视角图像,全参考评估面临挑战——例如LLFF数据集仅提供稀疏图像,不足以支持完整评估。为此,本文提出首个针对此类场景的无参考质量评估方法NeRF-NQA。该方法采用联合评估策略,融合视图级与点级分析:视图级评估单个合成视图的空间质量及视图间一致性;点级则关注场景表面点的视角特性及其点间复合质量。在23种主流视觉质量评估方法(涵盖图像、视频与光场领域)上的广泛对比显示,NeRF-NQA显著优于现有方法,在无参考条件下对NVS合成场景的评估表现尤为突出。代码已开源:https://github.com/VincentQQu/NeRF-NQA。
原文摘要 · Abstract (English)
Neural View Synthesis (NVS) has demonstrated efficacy in generating high-fidelity dense viewpoint videos using a image set with sparse views. However, existing quality assessment methods like PSNR, SSIM, and LPIPS are not tailored for the scenes with dense viewpoints synthesized by NVS and NeRF variants, thus, they often fall short in capturing the perceptual quality, including spatial and angular aspects of NVS-synthesized scenes. Furthermore, the lack of dense ground truth views makes the full reference quality assessment on NVS-synthesized scenes challenging. For instance, datasets such as LLFF provide only sparse images, insufficient for complete full-reference assessments. To address the issues above, we propose NeRF-NQA, the first no-reference quality assessment method for densely-observed scenes synthesized from the NVS and NeRF variants. NeRF-NQA employs a joint quality assessment strategy, integrating both viewwise and pointwise approaches, to evaluate the quality of NVS-generated scenes. The viewwise approach assesses the spatial quality of each individual synthesized view and the overall inter-views consistency, while the pointwise approach focuses on the angular qualities of scene surface points and their compound inter-point quality. Extensive evaluations are conducted to compare NeRF-NQA with 23 mainstream visual quality assessment methods (from fields of image, video, and light-field assessment). The results demonstrate NeRF-NQA outperforms the existing assessment methods significantly and it shows substantial superiority on assessing NVS-synthesized scenes without references. An implementation of this paper are available at https://github.com/VincentQQu/NeRF-NQA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。