arXiv:2504.06301eess.IVcs.CV2025-04被引 6

评测JPEG AI压缩图像的主观画质,发现主流评估指标高估了其真实体验。

Subjective Visual Quality Assessment for High-Fidelity Learning-Based Image Compression

  • 用三元比较法构建精细画质评分体系,基于人类视觉察觉阈值(JND)
  • 459人参与96200次测试,验证CVVDP等指标在高保真场景中普遍乐观
  • 首次引入统计检验方法提升评估可信度,数据全公开可复现

基于学习的图像压缩方法近年来成为传统编码器的有力替代,提供更优的率失真性能和感知质量。JPEG AI是该领域最新标准化框架,利用深度神经网络实现高保真图像重建。本研究采用JPEG AIC-3方法对JPEG AI压缩图像开展全面的主观视觉质量评估,以刚可觉察差异(JND)单位量化感知差异。从五个不同来源生成50张压缩图像,包含细粒度失真水平。通过大规模众包实验收集了459名参与者提交的96,200次三元组响应。基于提升与普通三元比较构建统一模型,重构了基于JND的质量尺度。此外,评估了多种客观图像质量指标在高保真范围与人类感知的一致性。结果显示CVVDP整体表现最优,但多数指标包括CVVDP均对JPEG AI压缩图像的质量预测过于乐观。研究强调在现代图像编解码器开发与基准测试中进行严格主观评估的重要性,尤其是在高保真范围内。另一技术贡献是将经典的Meng-Rosenthal-Rubin统计检验引入体验质量研究领域,可可靠评估质量指标与真实感知相关性的显著性差异。完整数据集(含所有主观评分)已公开于https://github.com/jpeg-aic/dataset-JPEG-AI-SDR25。

原文摘要 · Abstract (English)

Learning-based image compression methods have recently emerged as promising alternatives to traditional codecs, offering improved rate-distortion performance and perceptual quality. JPEG AI represents the latest standardized framework in this domain, leveraging deep neural networks for high-fidelity image reconstruction. In this study, we present a comprehensive subjective visual quality assessment of JPEG AI-compressed images using the JPEG AIC-3 methodology, which quantifies perceptual differences in terms of Just Noticeable Difference (JND) units. We generated a dataset of 50 compressed images with fine-grained distortion levels from five diverse sources. A large-scale crowdsourced experiment collected 96,200 triplet responses from 459 participants. We reconstructed JND-based quality scales using a unified model based on boosted and plain triplet comparisons. Additionally, we evaluated the alignment of multiple objective image quality metrics with human perception in the high-fidelity range. The CVVDP metric achieved the overall highest performance; however, most metrics including CVVDP were overly optimistic in predicting the quality of JPEG AI-compressed images. These findings emphasize the necessity for rigorous subjective evaluations in the development and benchmarking of modern image codecs, particularly in the high-fidelity range. Another technical contribution is the introduction of the well-known Meng-Rosenthal-Rubin statistical test to the field of Quality of Experience research. This test can reliably assess the significance of difference in performance of quality metrics in terms of correlation between metrics and ground truth. The complete dataset, including all subjective scores, is publicly available at https://github.com/jpeg-aic/dataset-JPEG-AI-SDR25.

图像压缩主观评估感知质量JPEG AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。