arXiv:2505.06995cs.CV2025-05

轻量级扩散模型,兼顾性能与内存效率

KDC-Diff: A Latent-Aware Diffusion Model with Knowledge Retention for Memory-Efficient Image Generation

  • 用双层知识蒸馏压缩大模型,保留语义与结构信息
  • 通过潜在空间回放实现持续学习,任务间性能稳定
  • 参数少、推理快,适合低资源设备部署

生成式AI在实际应用中日益普及,但基于扩散的文生图模型面临巨大的计算压力。本文提出KDC-Diff,一种新型可扩展生成框架,显著降低计算开销并保持高性能。其核心是结构简化后的U-Net,结合双层知识蒸馏策略,将大型教师模型的语义与结构特征迁移到学生模型。此外,引入基于潜在空间回放的持续学习机制,确保在连续任务中生成性能稳定。在基准数据集上的评估显示,该模型在FID、CLIP、KID和LPIPS指标上表现优异,同时大幅减少参数量、推理时间和浮点运算次数(FLOPs)。KDC-Diff为低资源环境下的扩散模型部署提供了实用、轻量且通用的解决方案,适用于下一代智能、资源感知计算系统。

原文摘要 · Abstract (English)

The growing adoption of generative AI in real-world applications has exposed a critical bottleneck in the computational demands of diffusion-based text-to-image models. In this work, we propose KDC-Diff, a novel and scalable generative framework designed to significantly reduce computational overhead while maintaining high performance. At its core, KDC-Diff designs a structurally streamlined U-Net with a dual-layered knowledge distillation strategy to transfer semantic and structural representations from a larger teacher model. Moreover, a latent-space replay-based continual learning mechanism is incorporated to ensure stable generative performance across sequential tasks. Evaluated on benchmark datasets, our model demonstrates strong performance across FID, CLIP, KID, and LPIPS metrics while achieving substantial reductions in parameter count, inference time, and FLOPs. KDC-Diff offers a practical, lightweight, and generalizable solution for deploying diffusion models in low-resource environments, making it well-suited for the next generation of intelligent and resource-aware computing systems.

扩散模型轻量化持续学习生成AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。