针对全景拼接画质评估,首次实现从通用到个体的精准预测。
GC360IQ: Generic-to-Individualized Quality Assessment for Stitched 360-Degree Panoramas

- 构建专用全景数据库,分离亮度与细节退化影响
- 通用模型准确预测拼接质量,个体适配提升评分精度
- 显式建模用户偏好差异,适合个性化视觉体验研究
现有图像质量评估(IQA)方法多预测平均意见分(MOS),难以捕捉个体主观差异。这一问题在拼接360°全景图中尤为显著,因用户对拼接处亮度不一致、细节丢失和几何错位的敏感度差异极大。本文提出GC360IQ,一种从通用到个体化的IQA框架,通过学习显式特征空间刻画个体行为。首先,构建专注拼接引起的亮度与细节退化、最小化几何错位的360°全景数据库,提供多维度质量评分及完整个体评分。其次,开发基于未拼接视图作为感知参考的通用质量模型,双分支特征提取聚焦拼接区域梯度与结构信息,预测基线质量。第三,建立紧凑偏好嵌入空间,作为显式特征域建模每个用户对通用质量感知的偏离,并引入最大后验(MAP)适应机制。利用该空间中学习到的偏好先验,新用户的独特行为嵌入可随锚点评分数量增加逐步映射。实验表明,通用模型可准确预测拼接质量,而个体适配进一步提升个体评分预测效果。深入分析显示,观察者差异具有结构性变化,关联评分倾向与对拼接伪影的敏感度,而非随机噪声。
原文摘要 · Abstract (English)
Existing image quality assessment (IQA) methods typically predict mean opinion scores (MOSs) but struggle to capture variations in individual subject behaviors. This limitation is highly pronounced in immersive visual applications such as stitched 360-degree panoramas, where user opinions diverge drastically based on personal sensitivity to blending-induced luminance inconsistency, detail loss, and geometric misalignment. Here we propose GC360IQ, a novel Generic-to-Individualized IQA framework that establishes a learned explicit feature space to characterize individual subject behaviors. First, we construct a specialized 360-degree panorama database focusing on blending-induced luminance and detail degradation while minimizing geometric misalignment, providing multidimensional quality ratings alongside complete individual scores. Second, we develop a generic quality model that utilizes unblended views as a perceptual reference. Dual feature extraction branches capture gradient and structural information specifically around stitching regions to predict baseline quality. Third, we construct a compact preference embedding space that acts as an explicit feature domain to model each subject's deviation from generic quality perceptions. We also introduce a maximum a posteriori (MAP) adaptation mechanism. By leveraging a preference prior learned within our explicit feature space, a new subject's unique behavioral embedding is mapped progressively with an increasing number of anchor ratings. Experiments demonstrate that the generic model provides accurate stitching quality predictions and that subject adaptation further improves individual score predictions. Deeper analysis of the collected ratings and learned embeddings reveals that observer differences contain structured variation related to scoring tendencies and sensitivity to stitching artifacts, rather than merely random rating noise.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。