arXiv:2608.28798cs.CV2026-08

基于人眼视觉机制,提出新方法评估全景立体图像质量。

Blind Stereoscopic Omnidirectional Image Quality Assessment Using Predictive Coding Hierarchy

论文配图:Blind Stereoscopic Omnidirectional Image Quality Assessment Using Predictive Coding Hierarchy
图 1 · 摘自论文原文
  • 模拟人眼感知,分局部与全局建模视点信息
  • 在多个数据集上优于现有方法,相关性达0.9以上
  • 适合虚拟现实图像质量评测,尤其关注沉浸感

全景立体图像(SOIs)为虚拟现实环境提供了全新的沉浸式体验。然而,由于视角自由变化和双眼视觉等因素,开发高效准确的感知质量评估指标仍具挑战性。本文基于人眼视觉系统(HVS)特性,提出一种受预测编码层次启发的盲评/无参考质量评估方法(PCH)。该方法包含局部中位感知模块、全局预测感知模块和视觉质量回归器。首先,通过提取多个视点,进行中位转换与显著性检测,模拟人脑对局部视觉信息的关注与整合;随后,依据双眼机制融合左右视图,构建预测编码层次模型以推断整体场景感知;最后,结合局部与全局感知线索,输出最终质量评分。大量实验表明,所提PCH在多个公开数据集上性能达到或超过当前最优方法,相关性均高于0.9。

原文摘要 · Abstract (English)

Stereoscopic omnidirectional images (SOIs) have provided users with newly immersive quality of experience in virtual reality environments. However, developing efficient and accurate perceptual quality assessment metrics for SOIs remains challenging due to many factors such as freely changeable field of views and binocular vision. In this paper, based on the characteristics of the human visual system (HVS), we propose a Predictive Coding Hierarchy-inspired metric (PCH) for blind/no-reference stereoscopic omnidirectional image quality assessment. Motivated by the viewing process of SOIs, the proposed PCH includes a local cyclopean perception module, a global predictive perception module, and a visual quality regressor. First, observers browse different spherical sceneries from viewports, and aggregate the local visual information to infer the perceptual quality of SOIs. Therefore, we extract various viewports, followed by cyclopean conversion and saliency detection to approach the perception and attention of the human brain. After the local aggregation, viewers then infer the global scene in their minds. Based on the binocular mechanism, we fuse left and right views to perform predictive coding hierarchy modelling. Finally, the visual quality regressor is exploited to obtain the ultimate quality score related to both local and global perceptual cues. Extensive experiments demonstrate that the proposed PCH achieves competitive and consistently improved performance compared with state-of-the-art quality assessment methods.

图像质量评估全景图像视觉感知虚拟现实

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。