让机器学习更省电、省资源,适合边缘设备运行
Frugal Machine Learning for Energy-efficient, and Resource-aware Artificial Intelligence
- 通过压缩模型、优化训练流程和减少数据依赖来降低资源消耗
- 支持在低带宽、低功耗环境下持续运行,避免频繁重训
- 适合物联网和边缘计算场景,推动智能设备绿色化
Frugal Machine Learning (FML) 指设计高效、低成本且考虑资源限制的机器学习模型,旨在以最少的计算资源、时间、能源和数据实现可接受的性能,涵盖训练与推理全过程。方法分为输入节俭、学习过程节俭和模型节俭三类,分别针对机器学习流水线不同阶段优化资源使用。本文探讨了 FML 在智能环境(如边缘计算与物联网设备)中的应用,这些场景常面临带宽、能耗或延迟的严格限制。文中讨论了模型压缩、节能硬件、数据高效学习等技术,以及参数正则化、知识蒸馏和动态架构设计等自适应方法,支持无需全量重训的增量更新。同时提供全面的节俭方法分类体系,分析跨领域案例,并指明未来研究方向,推动该领域的持续创新。
原文摘要 · Abstract (English)
Frugal Machine Learning (FML) refers to the practice of designing Machine Learning (ML) models that are efficient, cost-effective, and mindful of resource constraints. This field aims to achieve acceptable performance while minimizing the use of computational resources, time, energy, and data for both training and inference. FML strategies can be broadly categorized into input frugality, learning process frugality, and model frugality, each focusing on reducing resource consumption at different stages of the ML pipeline. This chapter explores recent advancements, applications, and open challenges in FML, emphasizing its importance for smart environments that incorporate edge computing and IoT devices, which often face strict limitations in bandwidth, energy, or latency. Technological enablers such as model compression, energy-efficient hardware, and data-efficient learning techniques are discussed, along with adaptive methods including parameter regularization, knowledge distillation, and dynamic architecture design that enable incremental model updates without full retraining. Furthermore, it provides a comprehensive taxonomy of frugal methods, discusses case studies across diverse domains, and identifies future research directions to drive innovation in this evolving field.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。