轻量化模型让边缘设备持续学习异常检测,内存减少91.5%
Memory Efficient Continual Learning for Edge-Based Visual Anomaly Detection
- 用压缩回放技术降低内存占用,实现边缘端持续学习
- PaSTe模型比STFPM快10%的像素级异常检测准确率
- 适合资源受限的实时监控场景部署
视觉异常检测(VAD)在计算机视觉中至关重要,但部署于边缘设备时面临计算与内存资源受限的挑战。真实场景中数据分布动态变化,要求模型持续适应,进一步加剧部署难度。本文研究边缘设备上的持续学习异常检测(CLAD)问题,评估了低内存开销的STFPM方法,发现其结合回放策略表现良好。进一步探索专为边缘设计但尚未用于持续学习的PaSTe方法,结果表明:PaSTe不仅比STFPM更轻量,且在回放技术下将像素级F1分数提升10%。其结构支持多类压缩回放,相比传统回放可减少最大91.5%的内存开销。本研究证明了在资源受限边缘设备上实现增量学习的VAD模型可行性。
原文摘要 · Abstract (English)
Visual Anomaly Detection (VAD) is a critical task in computer vision with numerous real-world applications. However, deploying these models on edge devices presents significant challenges, such as constrained computational and memory resources. Additionally, dynamic data distributions in real-world settings necessitate continuous model adaptation, further complicating deployment under limited resources. To address these challenges, we present a novel investigation into the problem of Continual Learning for Visual Anomaly Detection (CLAD) on edge devices. We evaluate the STFPM approach, given its low memory footprint on edge devices, which demonstrates good performance when combined with the Replay approach. Furthermore, we propose to study the behavior of a recently proposed approach, PaSTe, specifically designed for the edge but not yet explored in the Continual Learning context. Our results show that PaSTe is not only a lighter version of STPFM, but it also achieves superior anomaly detection performance, improving the f1 pixel performance by 10% with the Replay technique. In particular, the structure of PaSTe allows us to test it using a series of Compressed Replay techniques, reducing memory overhead by a maximum of 91.5% compared to the traditional Replay for STFPM. Our study proves the feasibility of deploying VAD models that adapt and learn incrementally on CLAD scenarios on resource-constrained edge devices.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。