arXiv:2510.13869cs.LGcs.AI2025-10被引 1

用低秩适配让生成对抗网络持续学少量样本,避免遗忘且参数量极低。

CoLoR-GAN: Continual Few-Shot Learning with Low-Rank Adaptation in Generative Adversarial Networks

  • 用低秩张量动态适配生成器和判别器,减少新增参数
  • 在多个基准上达到当前最优性能,参数量仅为基线的1/10
  • 提出层级低秩适配(LoRA in LoRA),进一步压缩模型规模

生成对抗网络中的持续学习在少样本场景下仍具挑战性,尤其易出现灾难性遗忘。现有先进方法如LFS-GAN在每轮训练中引入显著新增权重,长期累积影响巨大。本文提出CoLoR-GAN框架,结合低秩适配(LoRA)实现生成模型的持续少样本学习,通过低秩张量高效适应新任务,大幅降低参数量。采用基础LoRA即取得良好效果;为更优化适配器大小,进一步提出用于卷积层的层级低秩适配(LLoRA)。针对LoRA超参数敏感问题,提供实证研究以快速定位最优配置。在多个持续学习与少样本学习基准测试中验证了该方法的有效性,不仅达到当前最优性能,且资源消耗显著降低。源代码已开源于GitHub。

原文摘要 · Abstract (English)

Continual learning (CL) in the context of Generative Adversarial Networks (GANs) remains a challenging problem, particularly when it comes to learn from a few-shot (FS) samples without catastrophic forgetting. Current most effective state-of-the-art (SOTA) methods, like LFS-GAN, introduce a non-negligible quantity of new weights at each training iteration, which would become significant when considering the long term. For this reason, this paper introduces \textcolor{red}{\textbf{\underline{c}}}ontinual few-sh\textcolor{red}{\textbf{\underline{o}}}t learning with \textcolor{red}{\textbf{\underline{lo}}}w-\textcolor{red}{\textbf{\underline{r}}}ank adaptation in GANs named CoLoR-GAN, a framework designed to handle both FS and CL together, leveraging low-rank tensors to efficiently adapt the model to target tasks while reducing even more the number of parameters required. Applying a vanilla LoRA implementation already permitted us to obtain pretty good results. In order to optimize even further the size of the adapters, we challenged LoRA limits introducing a LoRA in LoRA (LLoRA) technique for convolutional layers. Finally, aware of the criticality linked to the choice of the hyperparameters of LoRA, we provide an empirical study to easily find the best ones. We demonstrate the effectiveness of CoLoR-GAN through experiments on several benchmark CL and FS tasks and show that our model is efficient, reaching SOTA performance but with a number of resources enormously reduced. Source code is available on \href{https://github.com/munsifali11/CoLoR-GAN}{Github.

持续学习少样本学习低秩适配GAN

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。