arXiv:2502.19644cs.CV2025-02中稿 · as a TVCG paper at…被引 6

提出自适应评分对齐学习,提升虚拟现实视频质量评估的持续适应能力。

Adaptive Score Alignment Learning for Continual Perceptual Quality Assessment of 360-Degree Videos in Virtual Reality

  • 通过相关性损失与误差损失联合优化,增强评分与主观感知的一致性。
  • 在动态场景下相比基线模型提升12.19%相关性,静态设置下提升4.78%。
  • 适用于资源受限的VR设备,支持持续学习中的关键帧提取与特征自适应。

虚拟现实视频质量评估(VR-VQA)旨在衡量360度视频的主观感知质量,对保障无失真用户体验至关重要。传统方法在静态数据集上训练,受限于失真多样性,难以在多样内容和动态分布变化中保持高相关性和精度。为此,本文提出自适应评分对齐学习(ASAL),融合相关性损失与误差损失,提升评分与人类主观评价的对齐度和预测精度。ASAL通过特征空间平滑实现对不断变化分布的自然适应,增强对未见内容的泛化能力。为进一步提升在动态VR环境中的持续学习能力,引入自适应记忆回放机制,构建新型持续学习(CL)框架。不同于传统方法,ASAL采用关键帧提取与特征自适应,应对非平稳变化,同时满足VR设备的计算与存储限制。我们建立了一个全面的VR-VQA及其持续学习基准,引入新数据划分与评估指标。实验表明,ASAL在静态联合训练设置下相关性提升最高达4.78%,在动态持续学习设置下提升达12.19%,验证了其在解决VR-VQA固有挑战上的有效性。代码已开源:https://github.com/ZhouKanglei/ASAL_CVQA。

原文摘要 · Abstract (English)

Virtual Reality Video Quality Assessment (VR-VQA) aims to evaluate the perceptual quality of 360-degree videos, which is crucial for ensuring a distortion-free user experience. Traditional VR-VQA methods trained on static datasets with limited distortion diversity struggle to balance correlation and precision. This becomes particularly critical when generalizing to diverse VR content and continually adapting to dynamic and evolving video distribution variations. To address these challenges, we propose a novel approach for assessing the perceptual quality of VR videos, Adaptive Score Alignment Learning (ASAL). ASAL integrates correlation loss with error loss to enhance alignment with human subjective ratings and precision in predicting perceptual quality. In particular, ASAL can naturally adapt to continually changing distributions through a feature space smoothing process that enhances generalization to unseen content. To further improve continual adaptation to dynamic VR environments, we extend ASAL with adaptive memory replay as a novel Continul Learning (CL) framework. Unlike traditional CL models, ASAL utilizes key frame extraction and feature adaptation to address the unique challenges of non-stationary variations with both the computation and storage restrictions of VR devices. We establish a comprehensive benchmark for VR-VQA and its CL counterpart, introducing new data splits and evaluation metrics. Our experiments demonstrate that ASAL outperforms recent strong baseline models, achieving overall correlation gains of up to 4.78\% in the static joint training setting and 12.19\% in the dynamic CL setting on various datasets. This validates the effectiveness of ASAL in addressing the inherent challenges of VR-VQA.Our code is available at https://github.com/ZhouKanglei/ASAL_CVQA.

VR质量评估持续学习360视频评分对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。