arXiv:2502.17788cs.LG2025-02综述被引 12

面向物联网数据流的设备端持续学习综述

On-device edge learning for IoT data streams: a survey

  • 梳理设备端神经网络与决策树的持续学习方法
  • 揭示资源受限下灾难性遗忘与概念漂移挑战
  • 适合边缘计算与智能物联网系统研发者阅读

本文综述了在智能环境中的分类任务背景下,针对神经网络(NNs)和决策树(DTs)的设备端持续学习方法。重点分析了数据架构(批处理与流式)和网络容量(云与边缘)带来的关键约束,这些因素影响微型机器学习(TinyML)算法设计,因数据流自然到达且不可控。文章详述了在资源受限的边缘设备上部署深度学习模型所面临的挑战,包括灾难性遗忘、数据效率低下,以及在开放世界设置下处理物联网表格数据的困难。尽管决策树在设备端训练中更节省内存,但其表达能力有限,需通过动态剪枝和元学习等机制适应复杂模式与概念漂移。强调了针对边缘应用定制的多指标性能评估的重要性,涵盖输出表现与内部表征指标。核心挑战在于将这些组件整合进自主在线系统,兼顾稳定性-可塑性权衡、前向-后向迁移及模型收敛性。

原文摘要 · Abstract (English)

This literature review explores continual learning methods for on-device training in the context of neural networks (NNs) and decision trees (DTs) for classification tasks on smart environments. We highlight key constraints, such as data architecture (batch vs. stream) and network capacity (cloud vs. edge), which impact TinyML algorithm design, due to the uncontrolled natural arrival of data streams. The survey details the challenges of deploying deep learners on resource-constrained edge devices, including catastrophic forgetting, data inefficiency, and the difficulty of handling IoT tabular data in open-world settings. While decision trees are more memory-efficient for on-device training, they are limited in expressiveness, requiring dynamic adaptations, like pruning and meta-learning, to handle complex patterns and concept drifts. We emphasize the importance of multi-criteria performance evaluation tailored to edge applications, which assess both output-based and internal representation metrics. The key challenge lies in integrating these building blocks into autonomous online systems, taking into account stability-plasticity trade-offs, forward-backward transfer, and model convergence.

持续学习边缘计算物联网设备端推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。