arXiv:2509.14777cs.CV2025-09被引 1

无需预训练模型和类别标签,用扩散模型高效生成超分辨率训练数据。

Dataset Distillation for Super-Resolution without Class Labels and Pre-trained Models

  • 基于高梯度块与CLIP特征聚类,筛选关键图像区域。
  • 仅用0.68%原始数据训练,性能损失仅0.3 dB。
  • 适合资源受限场景,训练时间大幅缩短至1小时。

深度神经网络训练日益依赖大规模数据集和大量计算资源,尤其在模型复杂度提升的背景下。数据蒸馏技术作为提高数据效率的潜在方案受到关注。在单图像超分辨率(SISR)领域,现有方法虽利用生成对抗网络(GAN)反演实现一定效果,但高度依赖预训练模型和类别信息,限制了泛化能力。本文提出一种无需类别标签和预训练超分模型的新数据蒸馏方法:首先提取高梯度块,并根据CLIP特征进行图像分类;随后在选中的图像块上微调扩散模型以学习其分布,进而合成蒸馏后的训练图像。实验表明,该方法在显著减少训练数据量的同时达到领先性能。当仅使用原始数据集0.68%进行基线Transformer模型训练时,仅损失0.3 dB性能;此时扩散模型微调耗时4小时,超分模型训练可在1小时内完成,远低于全量数据所需的11小时。

原文摘要 · Abstract (English)

Training deep neural networks has become increasingly demanding, requiring large datasets and significant computational resources, especially as model complexity advances. Data distillation methods, which aim to improve data efficiency, have emerged as promising solutions to this challenge. In the field of single image super-resolution (SISR), the reliance on large training datasets highlights the importance of these techniques. Recently, a generative adversarial network (GAN) inversion-based data distillation framework for SR was proposed, showing potential for better data utilization. However, the current method depends heavily on pre-trained SR networks and class-specific information, limiting its generalizability and applicability. To address these issues, we introduce a new data distillation approach for image SR that does not need class labels or pre-trained SR models. In particular, we first extract high-gradient patches and categorize images based on CLIP features, then fine-tune a diffusion model on the selected patches to learn their distribution and synthesize distilled training images. Experimental results show that our method achieves state-of-the-art performance while using significantly less training data and requiring less computational time. Specifically, when we train a baseline Transformer model for SR with only 0.68\% of the original dataset, the performance drop is just 0.3 dB. In this case, diffusion model fine-tuning takes 4 hours, and SR model training completes within 1 hour, much shorter than the 11-hour training time with the full dataset.

超分辨率数据蒸馏扩散模型无监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。