arXiv:2501.11511eess.IVcs.CV2025-01被引 15

针对全景图像局部失真问题,构建大样本数据库并提出感知引导模型。

Subjective and Objective Quality Assessment of Non-Uniformly Distorted Omnidirectional Images

  • 构建10320张非均匀失真全景图数据集,模拟镜头畸变影响。
  • 实验发现视角和失真范围显著影响主观质量评价。
  • 提出自适应模拟用户观看行为的感知模型,性能领先现有方法。

随着虚拟现实技术发展,全景图像质量评估(OIQA)成为研究热点,但多数工作聚焦于均匀失真问题,即图像各区域遭受相同程度噪声干扰,而忽略了非均匀失真——同一图像中不同区域受不同程度扰动的问题。此外,现有大部分OIQA模型仅在小规模数据集上验证,易导致过拟合,阻碍发展。为此,本文从主观与客观双重视角展开研究:构建包含10,320张非均匀失真全景图像的大规模数据库,每张图像基于一个或两个摄像头镜头的退化生成;通过精心设计的心理物理学实验,深入分析整体与个体因素(如失真范围、观看条件)对质量感知的影响;进一步提出一种感知引导的非均匀失真OIQA模型,通过自适应模拟用户观看行为实现更精准评估。实验结果表明,所提模型优于当前最先进方法。源代码已开源:https://github.com/RJL2000/OIQAND。

原文摘要 · Abstract (English)

Omnidirectional image quality assessment (OIQA) has been one of the hot topics in IQA with the continuous development of VR techniques, and achieved much success in the past few years. However, most studies devote themselves to the uniform distortion issue, i.e., all regions of an omnidirectional image are perturbed by the ``same amount'' of noise, while ignoring the non-uniform distortion issue, i.e., partial regions undergo ``different amount'' of perturbation with the other regions in the same omnidirectional image. Additionally, nearly all OIQA models are verified on the platforms containing a limited number of samples, which largely increases the over-fitting risk and therefore impedes the development of OIQA. To alleviate these issues, we elaborately explore this topic from both subjective and objective perspectives. Specifically, we construct a large OIQA database containing 10,320 non-uniformly distorted omnidirectional images, each of which is generated by considering quality impairments on one or two camera len(s). Then we meticulously conduct psychophysical experiments and delve into the influence of both holistic and individual factors (i.e., distortion range and viewing condition) on omnidirectional image quality. Furthermore, we propose a perception-guided OIQA model for non-uniform distortion by adaptively simulating users' viewing behavior. Experimental results demonstrate that the proposed model outperforms state-of-the-art methods. The source code is available at https://github.com/RJL2000/OIQAND.

图像质量评估全景图像非均匀失真感知建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。