让边缘设备高效运行多个神经网络,边训练边推理,能耗几乎不变。
E-QUARTIC: Energy Efficient Edge Ensemble of Convolutional Neural Networks for Resource-Optimized Learning
- 设计多模型集成框架,动态选择节能模式
- 在相同内存下准确率更高,系统故障率降低40%
- 适合电池供电或能量采集的嵌入式智能设备
集成学习通过融合多个模型预测提升准确率和鲁棒性,但传统卷积神经网络(CNN)集成带来高内存与计算开销,难以部署于嵌入式系统。这类设备通常依赖小容量电池供电,或配备环境能量采集模块。本文提出E-QUARTIC,一种面向人工智能嵌入式系统的高效边缘集成框架。该设计在保持相似内存占用的前提下,优于单实例CNN基线及现有边缘AI方案,提升准确率并适应不同能量条件。利用多CNN结构实现能量感知的模型选择策略,在能量采集系统中将系统故障率降低最多40%,同时保证更高平均输出质量。最终证明,该设计可在边缘端实现并发本地训练与高质量推理,性能与能耗开销均低于0.04%。
原文摘要 · Abstract (English)
Ensemble learning is a meta-learning approach that combines the predictions of multiple learners, demonstrating improved accuracy and robustness. Nevertheless, ensembling models like Convolutional Neural Networks (CNNs) result in high memory and computing overhead, preventing their deployment in embedded systems. These devices are usually equipped with small batteries that provide power supply and might include energy-harvesting modules that extract energy from the environment. In this work, we propose E-QUARTIC, a novel Energy Efficient Edge Ensembling framework to build ensembles of CNNs targeting Artificial Intelligence (AI)-based embedded systems. Our design outperforms single-instance CNN baselines and state-of-the-art edge AI solutions, improving accuracy and adapting to varying energy conditions while maintaining similar memory requirements. Then, we leverage the multi-CNN structure of the designed ensemble to implement an energy-aware model selection policy in energy-harvesting AI systems. We show that our solution outperforms the state-of-the-art by reducing system failure rate by up to 40% while ensuring higher average output qualities. Ultimately, we show that the proposed design enables concurrent on-device training and high-quality inference execution at the edge, limiting the performance and energy overheads to less than 0.04%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。