构建40张4K图像+10段1080p视频测试集,填补编码评估空白。
USTC-TD: A Test Dataset and Benchmark for Image and Video Coding in 2020s
- 设计包含多场景、光照、运动等变量的高质量图像视频数据集
- 在PSNR、MS-SSIM、VMAF和MOS上验证了编码方案性能基准
- 适用于图像视频编码算法评测,适合标准制定与工业应用
图像/视频编码长期是学术与工业重要研究方向。高质量测试数据集对编码研究评估、实际应用及标准制定至关重要。本文提出USTC-TD测试集,已用于2022与2023年IEEE VCIP会议的端到端编码挑战赛。该数据集包含40张4K分辨率图像和10段1080p分辨率视频,涵盖多样内容,源于不同场景类型、纹理、运动、视角及照明、镜头、阴影等成像因素。通过空间、时间、色彩、亮度等特征量化分析,验证其弥补现有数据集不足。同时使用PSNR、MS-SSIM、VMAF和主观评分MOS,对经典标准与新兴学习型编码方案进行广泛评估,建立完整基准。基于数据集特性,分析基准表现,展望未来编码发展方向。所有数据公开可获取:https://esakak.github.io/USTC-TD。
原文摘要 · Abstract (English)
Image/video coding has been a remarkable research area for both academia and industry for many years. Testing datasets, especially high-quality image/video datasets are desirable for the justified evaluation of coding-related research, practical applications, and standardization activities. We put forward a test dataset namely USTC-TD, which has been successfully adopted in the practical end-to-end image/video coding challenge of the IEEE International Conference on Visual Communications and Image Processing (VCIP) in 2022 and 2023. USTC-TD contains 40 images at 4K spatial resolution and 10 video sequences at 1080p spatial resolution, featuring various content due to the diverse environmental factors (e.g. scene type, texture, motion, view) and the designed imaging factors (e.g. illumination, lens, shadow). We quantitatively evaluate USTC-TD on different image/video features (spatial, temporal, color, lightness), and compare it with the previous image/video test datasets, which verifies its excellent compensation for the shortcomings of existing datasets. We also evaluate both classic standardized and recently learned image/video coding schemes on USTC-TD using objective quality metrics (PSNR, MS-SSIM, VMAF) and subjective quality metric (MOS), providing an extensive benchmark for these evaluated schemes. Based on the characteristics and specific design of the proposed test dataset, we analyze the benchmark performance and shed light on the future research and development of image/video coding. All the data are released online: https://esakak.github.io/USTC-TD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。