arXiv:2410.06645cs.CV2024-10NeurIPS被引 26

用频域分析提升持续学习效率,适合资源受限设备。

Continual Learning in the Frequency Domain

  • 将图像转至频域,压缩特征图大小以降低计算量。
  • 根据类别频域相似性选择性复现输出特征,减少干扰。
  • 兼容主流重放方法,显著提升精度与训练速度。

持续学习(CL)旨在学习新任务的同时保留已有知识。基于重放的策略虽能有效缓解遗忘问题,但其训练效率研究不足,限制了在资源受限场景的应用。人类视觉系统对不同频率成分敏感,可高效剔除冗余信息。受此启发,本文提出首个利用频域特征提升边缘设备上持续学习性能与效率的框架——频域持续学习(CLFD)。CLFD通过小波变换将输入图像映射至频域,显著压缩特征图尺寸;同时,根据类别在频域中的相似性,选择性地使用输出特征进行分类,平衡特征复用与干扰。仅优化特征提取器的输入与输出特征,使CLFD可无缝集成至各类重放方法。在云与边缘环境的大量实验表明,CLFD持续提升先进方法的精度与训练效率:最高使SOTA方法准确率提升6.83%,训练时间缩短2.6倍。

原文摘要 · Abstract (English)

Continual learning (CL) is designed to learn new tasks while preserving existing knowledge. Replaying samples from earlier tasks has proven to be an effective method to mitigate the forgetting of previously acquired knowledge. However, the current research on the training efficiency of rehearsal-based methods is insufficient, which limits the practical application of CL systems in resource-limited scenarios. The human visual system (HVS) exhibits varying sensitivities to different frequency components, enabling the efficient elimination of visually redundant information. Inspired by HVS, we propose a novel framework called Continual Learning in the Frequency Domain (CLFD). To our knowledge, this is the first study to utilize frequency domain features to enhance the performance and efficiency of CL training on edge devices. For the input features of the feature extractor, CLFD employs wavelet transform to map the original input image into the frequency domain, thereby effectively reducing the size of input feature maps. Regarding the output features of the feature extractor, CLFD selectively utilizes output features for distinct classes for classification, thereby balancing the reusability and interference of output features based on the frequency domain similarity of the classes across various tasks. Optimizing only the input and output features of the feature extractor allows for seamless integration of CLFD with various rehearsal-based methods. Extensive experiments conducted in both cloud and edge environments demonstrate that CLFD consistently improves the performance of state-of-the-art (SOTA) methods in both precision and training efficiency. Specifically, CLFD can increase the accuracy of the SOTA CL method by up to 6.83% and reduce the training time by 2.6$\times$.

持续学习频域分析边缘计算小波变换

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。