为嵌入式系统设计流学习模型,需同时考虑资源消耗与概念漂移适应。
Towards Stream Learning on Embedded Systems: Benchmarking the Memory Consumption of Stream Learning Methods

- 在128KiB至8MiB内存预算下,测试7种分类器在13个数据流上的表现
- 自适应集成模型初始内存占用高,增量树随数据流增长超7倍
- 提出资源预算接口API,推动将资源约束作为核心设计目标
流学习通常以预测性能和概念漂移适应性进行评估,但在长期运行中,嵌入式系统仍需可预测且有界的资源使用。当前主流方法聚焦于漂移适应,而资源消耗常被忽视。本文在13个真实与合成数据流上,对7种代表性流分类器在128KiB至约8MiB模型大小预算下进行6,463次实验。测量失败感知准确率、峰值模型大小、预算耗尽时间及预测+更新延迟。结果揭示两种资源失效模式:自适应集成模型因初始占用过高,几乎立即超出小预算;增量树(如HoeffdingTree和EFDT)在长流中分别中位增长7.37倍和5.87倍。显式紧凑方法仅在最小预算下可行,更大预算下自适应集成才具竞争力。因此,许多先进方法在嵌入式或长时间运行场景中不适用。本文呼吁将资源使用约束作为与漂移适应同等重要的设计目标,并提出通过API显式暴露与尊重资源预算的具体路径。
原文摘要 · Abstract (English)
Stream learning is commonly evaluated through predictive performance and adaptation to concept drift. However, sustained operation of a stream learner also requires predictable and bounded resource usage even on long streams. This requirement becomes even more critical when learning moves from servers to near-sensor embedded systems where memory and processing are scarce resources. In state-of-the-art stream learning, however, we perceive a strong focus on concept drift adaptation, whereas resource usage is often an evaluation byproduct. To close this gap, we benchmark seven representative stream classifiers on 13 real and synthetic streams under model-size budgets from 128\,KiB to approximately 8\,MiB. Our benchmark comprises a total of 6,463 experiments. We measure failure-aware accuracy, peak model size, time to budget exhaustion, and prediction-plus-update latency. The results reveal two distinct resource failure modes. Adaptive ensembles can exceed small budgets almost immediately because of their initial footprint, even when their size remains stable thereafter. Incremental trees can fit initially but grow throughout a long stream, with HoeffdingTrees (HT) and Extremely Fast Decision Trees (EFDT) increasing by median factors of 7.37 and 5.87. Explicitly compact methods remain the only viable option under the smallest budgets, but are usually overtaken as larger budgets make adaptive ensembles competitive. Hence, many state-of-the-art methods are only partially applicable in embedded systems or for long-running systems. We therefore call on the stream-learning community to make bounded resource usage a first-class design objective alongside drift adaptation, and propose concrete steps toward this goal, including an API through which stream learners can explicitly expose and respect resource budgets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。