针对渲染视频设计新数据集与评估指标,提升无参考质量判断准确性。
No-Reference Rendered Video Quality Assessment: Dataset and Metrics
- 构建面向渲染视频的主观标注数据集,覆盖多种3D场景与显示类型。
- 提出兼顾图像质量和时间稳定性的新无参考评估指标,显著优于现有方法。
- 可应用于超采样与实时渲染帧生成策略的性能评估,适合图形学研究者。
视频质量评估对视频游戏、虚拟现实和增强现实等计算机图形应用至关重要,视觉表现直接影响用户体验。当测试视频无法与参考视频完全对齐或参考缺失时,无参考视频质量评估(NR-VQA)的重要性不言而喻。然而,现有NR-VQA数据集和指标主要针对相机拍摄视频,直接用于渲染视频会产生偏差,因渲染视频更易出现时间伪影。为此,我们提出了一个大规模面向渲染视频的主观质量标注数据集,以及专为渲染视频设计的NR-VQA指标。该数据集涵盖多种3D场景与渲染设置,质量评分针对不同显示类型进行标注,更贴近真实应用场景。基于此数据集,我们校准了新指标,通过同时分析图像质量与时间稳定性来评估渲染视频质量。实验表明,该指标在渲染视频上的表现优于现有方法。最后,验证了其可用于超采样方法的基准评测及实时渲染中帧生成策略的评估。
原文摘要 · Abstract (English)
Quality assessment of videos is crucial for many computer graphics applications, including video games, virtual reality, and augmented reality, where visual performance has a significant impact on user experience. When test videos cannot be perfectly aligned with references or when references are unavailable, the significance of no-reference video quality assessment (NR-VQA) methods is undeniable. However, existing NR-VQA datasets and metrics are primarily focused on camera-captured videos; applying them directly to rendered videos would result in biased predictions, as rendered videos are more prone to temporal artifacts. To address this, we present a large rendering-oriented video dataset with subjective quality annotations, as well as a designed NR-VQA metric specific to rendered videos. The proposed dataset includes a wide range of 3D scenes and rendering settings, with quality scores annotated for various display types to better reflect real-world application scenarios. Building on this dataset, we calibrate our NR-VQA metric to assess rendered video quality by looking at both image quality and temporal stability. We compare our metric to existing NR-VQA metrics, demonstrating its superior performance on rendered videos. Finally, we demonstrate that our metric can be used to benchmark supersampling methods and assess frame generation strategies in real-time rendering.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。