arXiv:2503.22175cs.CV2025-03被引 1

通过频率分解提升持续学习效率,显著降低资源消耗。

Efficient Continual Learning through Frequency Decomposition and Integration

  • 将图像分低频与高频独立处理,利用频率特性增强泛化能力。
  • 相比顶尖方法准确率提升7.49%,模型参数减少78%。
  • 适合边缘设备部署,训练速度最快提升5倍。

持续学习旨在学习新任务的同时保留旧知识,缓解任务适应过程中的遗忘问题。基于回放的方法通过重放旧样本有效缓解遗忘,但在资源受限环境下的效率提升研究仍较匮乏,限制了其在动态数据流系统中的应用。人类感知系统通过互补的频率通道处理视觉场景:低频信号捕捉整体线索,高频成分则传递精细结构信息以实现细粒度区分。受此启发,我们提出频率分解与融合网络(FDINet),一种新型框架,可跨频率分解与整合信息。FDINet设计两个轻量级网络,分别处理图像的低频与高频成分。结合回放方法后,该频率感知设计通过低频信息有效提升跨任务泛化能力,利用高频信息保留类别特异性细节,并因轻量架构促进高效训练。实验表明,FDINet使主干参数减少78%,准确率最高比当前最优方法提升7.49%,峰值内存使用量降低达80%。此外,在边缘设备上,训练速度最快提升5倍。

原文摘要 · Abstract (English)

Continual learning (CL) aims to learn new tasks while retaining past knowledge, addressing the challenge of forgetting during task adaptation. Rehearsal-based methods, which replay previous samples, effectively mitigate forgetting. However, research on enhancing the efficiency of these methods, especially in resource-constrained environments, remains limited, hindering their application in real-world systems with dynamic data streams. The human perceptual system processes visual scenes through complementary frequency channels: low-frequency signals capture holistic cues, while high-frequency components convey structural details vital for fine-grained discrimination. Inspired by this, we propose the Frequency Decomposition and Integration Network (FDINet), a novel framework that decomposes and integrates information across frequencies. FDINet designs two lightweight networks to independently process low- and high-frequency components of images. When integrated with rehearsal-based methods, this frequency-aware design effectively enhances cross-task generalization through low-frequency information, preserves class-specific details using high-frequency information, and facilitates efficient training due to its lightweight architecture. Experiments demonstrate that FDINet reduces backbone parameters by 78%, improves accuracy by up to 7.49% over state-of-the-art (SOTA) methods, and decreases peak memory usage by up to 80%. Additionally, on edge devices, FDINet accelerates training by up to 5$\times$.

持续学习频率分解轻量化边缘计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。