arXiv:2502.19046eess.IVcs.CV2025-02被引 16

提出多轴注意力模型,精准评估360度图像的全局与局部失真质量。

Max360IQ: Blind Omnidirectional Image Quality Assessment with Multi-axis Attention

  • 采用多轴注意力捕捉全景图的全局与局部空间关系
  • 在非均匀失真数据集上比SOTA提升3.6%相关性
  • 适合虚拟现实、全景视频等沉浸式应用的质量评估

全景图像(360度图像)可捕捉完整360度场景,为用户提供比普通2D或立体图像更真实的沉浸体验。然而,这种特性也给感知质量评估带来巨大挑战,尤其当图像出现非均匀失真时,直接影响用户体验。本文提出一种新型盲态全景图像质量评估模型Max360IQ,能有效评估均匀与非均匀失真下的全景图像质量。该模型由堆叠的多轴注意力模块构成主干网络,用于捕捉提取视口间的全局与局部空间交互;引入多尺度特征融合(MSFI)模块融合多尺度特征;并设计带有深层语义引导的质量回归模块以预测质量。实验结果表明,Max360IQ在含非均匀失真的JUFE数据库上相较SOTA方法Assessor360提升3.6%的SRCC,且在OIQA和CVIQ数据库上分别提升0.4%和0.8%。源代码已开源。

原文摘要 · Abstract (English)

Omnidirectional image, also called 360-degree image, is able to capture the entire 360-degree scene, thereby providing more realistic immersive feelings for users than general 2D image and stereoscopic image. Meanwhile, this feature brings great challenges to measuring the perceptual quality of omnidirectional images, which is closely related to users' quality of experience, especially when the omnidirectional images suffer from non-uniform distortion. In this paper, we propose a novel and effective blind omnidirectional image quality assessment (BOIQA) model with multi-axis attention (Max360IQ), which can proficiently measure not only the quality of uniformly distorted omnidirectional images but also the quality of non-uniformly distorted omnidirectional images. Specifically, the proposed Max360IQ is mainly composed of a backbone with stacked multi-axis attention modules for capturing both global and local spatial interactions of extracted viewports, a multi-scale feature integration (MSFI) module to fuse multi-scale features and a quality regression module with deep semantic guidance for predicting the quality of omnidirectional images. Experimental results demonstrate that the proposed Max360IQ outperforms the state-of-the-art Assessor360 by 3.6\% in terms of SRCC on the JUFE database with non-uniform distortion, and gains improvement of 0.4\% and 0.8\% in terms of SRCC on the OIQA and CVIQ databases, respectively. The source code is available at https://github.com/WenJuing/Max360IQ.

图像质量评估全景图像多轴注意力盲评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。