针对游戏画面质量评估难题,提出语义感知的无参考评估模型。
Semantically-Aware Game Image Quality Assessment
- 用知识蒸馏提取游戏特有失真特征,结合场景语义动态加权。
- 在不同画质设置下训练,对未见游戏仍保持稳定质量趋势。
- 适合游戏开发者、引擎优化与自动化测试场景使用。
视频游戏图像质量评估面临无参考图像及独特失真(如走样、纹理模糊、几何LOD问题)的挑战,现有无参考图像/视频质量评估方法因主要针对压缩伪影,难以泛化至游戏环境。本文提出一种面向游戏的语义感知无参考图像质量评估模型,采用知识蒸馏的游戏中失真特征提取器(GDFE)检测并量化游戏特有失真,同时通过CLIP嵌入实现语义门控,依据场景内容动态调整特征重要性。模型在跨画质预设的游戏录制数据上训练,生成与人类感知一致的质量评分。结果表明,经知识蒸馏训练的GDFE能有效泛化至训练中未见的中间失真水平;语义门控进一步提升上下文相关性并降低预测方差。在缺乏领域内基准的情况下,该模型优于域外方法,在同类型未见游戏中仍表现出稳健且单调的质量趋势。本工作为游戏图形质量自动化评估奠定了基础,推动了该领域的无参考评估方法发展。
原文摘要 · Abstract (English)
Assessing the visual quality of video game graphics presents unique challenges due to the absence of reference images and the distinct types of distortions, such as aliasing, texture blur, and geometry level of detail (LOD) issues, which differ from those in natural images or user-generated content. Existing no-reference image and video quality assessment (NR-IQA/VQA) methods fail to generalize to gaming environments as they are primarily designed for distortions like compression artifacts. This study introduces a semantically-aware NR-IQA model tailored to gaming. The model employs a knowledge-distilled Game distortion feature extractor (GDFE) to detect and quantify game-specific distortions, while integrating semantic gating via CLIP embeddings to dynamically weight feature importance based on scene content. Training on gameplay data recorded across graphical quality presets enables the model to produce quality scores that align with human perception. Our results demonstrate that the GDFE, trained through knowledge distillation from binary classifiers, generalizes effectively to intermediate distortion levels unseen during training. Semantic gating further improves contextual relevance and reduces prediction variance. In the absence of in-domain NR-IQA baselines, our model outperforms out-of-domain methods and exhibits robust, monotonic quality trends across unseen games in the same genre. This work establishes a foundation for automated graphical quality assessment in gaming, advancing NR-IQA methods in this domain.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。