arXiv:2505.21099cs.CV2025-05被引 1

用10%数据量实现超分辨率模型同等性能,训练更高效。

Instance Data Condensation for Image Super-Resolution

  • 按图像独立压缩,适配超分任务的高分辨率与无标签需求。
  • 在DIV2K数据集上仅用10%样本,性能媲美全量数据。
  • 结合傅里叶特征与多层级分布匹配,生成细节丰富的合成图像。

基于深度学习的图像超分辨率(ISR)依赖大规模训练数据以优化模型泛化能力,但带来巨大的计算与存储开销。尽管数据压缩(DC)在高层视觉任务中展现潜力,但直接应用于ISR存在挑战,因后者需处理无标签高分辨率图像及精细细节。本文提出针对ISR的实例数据压缩(IDC)框架,采用逐图像压缩策略,解决现有方法不适用的问题。该框架引入随机局部傅里叶特征提取与多层级特征分布匹配机制,从全局和局部层面对齐合成内容与原始高分辨率样本的特征分布。在最常用的ISR数据集DIV2K上,以10%的压缩率生成合成数据集,其在多种主流ISR模型上的训练表现与原始全量数据相当,并具备优异稳定性。据我们所知,这是首个在10%数据量下达到此性能的合成数据集。

原文摘要 · Abstract (English)

Deep learning based Image Super-Resolution (ISR) relies on large training datasets to optimize model generalization; this requires substantial computational and storage resources during training. While dataset condensation (DC) has shown potential in improving data efficiency for high-level computer vision tasks, adopting these methods for ISR is not straightforward due to the different requirements of ISR training, including the use of unlabeled datasets and high resolution images with fine details. In this paper, we propose a novel Instance Data Condensation (IDC) framework specifically for ISR, which achieves data condensation in a per-image manner, aiming to address the limitations when directly applying existing DC methods to the ISR task. Furthermore, the IDC framework is based on a novel Random Local Fourier Feature Extraction and Multi-level Feature Distribution Matching methods, which are designed to generate high-quality synthesized content by aligning its feature distributions with those of the original high-resolution training samples at both global and local levels. This framework has been utilized to condense the most commonly used training dataset for ISR, DIV2K, with a 10% condensation rate. The resulting synthetic dataset offers comparable performance to the original full dataset and excellent training stability when used to train various popular ISR models. To the best of our knowledge, this is the first time that a condensed/synthetic dataset (with a 10% data volume) has demonstrated such performance.

图像超分数据压缩生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。