用强化学习生成观感路径,自动评估全景图像质量
RL-ScanIQA: Reinforcement-Learned Scanpaths for Blind 360°Image Quality Assessment
- 用强化学习联合优化观感路径和质量评分模型
- 在三个数据集上表现优于现有方法,跨数据集泛化更强
- 适合做全景图像质量评估或视觉注意力建模的研究者
盲态360°图像质量评估(IQA)旨在无原始参考的情况下预测全景图像的主观感知质量。与平面图像不同,沉浸式环境中观众在同一时刻只能看到有限视口,观看行为对质量感知至关重要。现有基于观感路径的方法虽尝试模拟‘先看后评’的人类模式,但将路径生成与质量评估分开处理,难以端到端优化且探索方向不匹配任务目标。为此,我们提出RL-ScanIQA,一种基于强化学习的盲态360°IQA框架。该框架联合优化由PPO训练的观感路径策略与质量评估器,策略通过质量反馈学习任务相关的观看策略。为提升训练稳定性并防止模式坍缩,设计多层级奖励,包括路径多样性及赤道偏好先验。进一步通过畸变空间增强与秩一致损失提升跨数据集鲁棒性,有效保持图像内与图像间的质量排序关系。在三个基准数据集上的大量实验表明,RL-ScanIQA在同数据集性能与跨数据集泛化能力上均优于现有方法。
原文摘要 · Abstract (English)
Blind 360°image quality assessment (IQA) aims to predict perceptual quality for panoramic images without a pristine reference. Unlike conventional planar images, 360°content in immersive environments restricts viewers to a limited viewport at any moment, making viewing behaviors critical to quality perception. Although existing scanpath-based approaches have attempted to model viewing behaviors by approximating the human view-then-rate paradigm, they treat scanpath generation and quality assessment as separate steps, preventing end-to-end optimization and task-aligned exploration. To address this limitation, we propose RL-ScanIQA, a reinforcement-learned framework for blind 360°IQA. RL-ScanIQA optimize a PPO-trained scanpath policy and a quality assessor, where the policy receives quality-driven feedback to learn task-relevant viewing strategies. To improve training stability and prevent mode collapse, we design multi-level rewards, including scanpath diversity and equator-biased priors. We further boost cross-dataset robustness using distortion-space augmentation together with rank-consistent losses that preserve intra-image and inter-image quality orderings. Extensive experiments on three benchmarks show that RL-ScanIQA achieves superior in-dataset performance and cross-dataset generalization. Codes are available at https://github.com/wangyuji1/RLScanIQA.git.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。