根据任务动态选模型,节能近25%还能保持95%精度。
Choosing to Be Green: Advancing Green AI via Dynamic Model Selection
- 按任务和能耗动态选最优模型,兼顾效率与环保。
- 实测可省电约25%,精度保留最耗能模型的95%。
- 适合关注绿色AI的开发者与部署团队。
人工智能在各领域广泛应用,但复杂模型如深度神经网络和大语言模型消耗大量计算资源与能源。本文提出绿色AI动态模型选择方法,通过综合考虑推理任务、模型环保性及准确率要求,动态选择最合适的模型。提出两种实现方式:绿色AI动态模型级联与路由。基于真实数据集的验证表明,该方法可实现最高约25%的能耗节省,同时保持最耗能方案约95%的准确率。初步结果表明,混合自适应模型选择策略可在不显著牺牲准确率的前提下,有效缓解现代AI系统的能源需求。
原文摘要 · Abstract (English)
Artificial Intelligence is increasingly pervasive across domains, with ever more complex models delivering impressive predictive performance. This fast technological advancement however comes at a concerning environmental cost, with state-of-the-art models - particularly deep neural networks and large language models - requiring substantial computational resources and energy. In this work, we present the intuition of Green AI dynamic model selection, an approach based on dynamic model selection that aims at reducing the environmental footprint of AI by selecting the most sustainable model while minimizing potential accuracy loss. Specifically, our approach takes into account the inference task, the environmental sustainability of available models, and accuracy requirements to dynamically choose the most suitable model. Our approach presents two different methods, namely Green AI dynamic model cascading and Green AI dynamic model routing. We demonstrate the effectiveness of our approach via a proof of concept empirical example based on a real-world dataset. Our results show that Green AI dynamic model selection can achieve substantial energy savings (up to ~25%) while substantially retaining the accuracy of the most energy greedy solution (up to ~95%). As conclusion, our preliminary findings highlight the potential that hybrid, adaptive model selection strategies withhold to mitigate the energy demands of modern AI systems without significantly compromising accuracy requirements.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。