针对边缘模型遗忘问题,提出按差异性加权回放历史数据的新方法。
Catastrophic Forgetting Mitigation via Discrepancy-Weighted Experience Replay
- 用多核MMD度量域间差异,优先选择与当前域最不同的历史数据。
- 在贝尔维尤交通数据集上,性能优于现有方法,尤其在昼夜交替场景下提升显著。
- 适合需要持续学习的智能交通监控系统,可提升边缘设备长期适应能力。
在动态交通环境中,云边协同目标检测的边缘模型持续适应新数据分布时面临灾难性遗忘问题,导致丢失已有知识。尤其在存在周期性变化(如昼夜、高峰时段)的场景中,过往知识仍具价值。现有方法如经验回放和视觉提示虽有一定缓解作用,但难以有效区分历史数据的重要性。本文提出基于自适应经验回放的ER-EMU算法,采用有限容量的先进先出(FIFO)经验缓冲区,并设计域距离度量式经验选择(DDM-ES)机制。该机制利用多核最大均值差异(MK-MMD)量化目标域间的差异性,优先选取与当前目标域差异最大的历史样本,增强训练多样性,促进多领域知识保留,同时避免对新域过拟合。缓冲区通过简单随机采样更新,保持历史域的均衡表征。在包含重复昼夜循环的Bellevue交通视频数据集上的实验表明,ER-EMU持续提升了多个前沿云边协同目标检测框架的性能。
原文摘要 · Abstract (English)
Continually adapting edge models in cloud-edge collaborative object detection for traffic monitoring suffers from catastrophic forgetting, where models lose previously learned knowledge when adapting to new data distributions. This is especially problematic in dynamic traffic environments characterised by periodic variations (e.g., day/night, peak hours), where past knowledge remains valuable. Existing approaches like experience replay and visual prompts offer some mitigation, but struggle to effectively prioritize and leverage historical data for optimal knowledge retention and adaptation. Specifically, simply storing and replaying all historical data can be inefficient, while treating all historical experiences as equally important overlooks their varying relevance to the current domain. This paper proposes ER-EMU, an edge model update algorithm based on adaptive experience replay, to address these limitations. ER-EMU utilizes a limited-size experience buffer managed using a First-In-First-Out (FIFO) principle, and a novel Domain Distance Metric-based Experience Selection (DDM-ES) algorithm. DDM-ES employs the multi-kernel maximum mean discrepancy (MK-MMD) to quantify the dissimilarity between target domains, prioritizing the selection of historical data that is most dissimilar to the current target domain. This ensures training diversity and facilitates the retention of knowledge from a wider range of past experiences, while also preventing overfitting to the new domain. The experience buffer is also updated using a simple random sampling strategy to maintain a balanced representation of previous domains. Experiments on the Bellevue traffic video dataset, involving repeated day/night cycles, demonstrate that ER-EMU consistently improves the performance of several state-of-the-art cloud-edge collaborative object detection frameworks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。