EcoThink动态调整AI推理计算,节能超40%且不丢性能。
EcoThink: A Green Adaptive Inference Framework for Sustainable and Accessible Agents
- 用轻量路由模型判断问题难易,简单问题跳过复杂推理
- 平均降低40.4%推理能耗,网页知识检索最高降81.9%
- 适合关注绿色AI、资源受限部署的开发者与研究者
随着网络从静态检索转向生成式交互,大型语言模型(LLMs)日益增长的环境足迹已成为可持续发展的重大挑战。当前范式对数十亿每日查询无差别应用计算密集型策略(如思维链CoT),导致大模型过度思考,造成冗余并加剧碳排放与资源门槛。这种低效直接阻碍联合国可持续发展目标13(气候行动)与10(减少不平等),限制资源匮乏地区的公平AI访问。为此,我们提出EcoThink——一种面向可持续与可及性的能源感知自适应推理框架。EcoThink采用基于蒸馏的轻量级路由器,动态评估查询复杂度,对事实类检索跳过冗余推理,仅在复杂逻辑任务保留深度计算。在9个多样化基准上的广泛评估表明,EcoThink平均降低40.4%的推理能耗(网页知识检索最高达81.9%),且性能无统计显著损失。通过减少算法浪费,EcoThink为构建可持续、包容性与能效优化的生成式AI智能体提供可扩展路径。
原文摘要 · Abstract (English)
As the Web transitions from static retrieval to generative interaction, the escalating environmental footprint of Large Language Models (LLMs) presents a critical sustainability challenge. Current paradigms indiscriminately apply computation-intensive strategies like Chain-of-Thought (CoT) to billions of daily queries, causing LLM overthinking, a redundancy that amplifies carbon emissions and operational barriers. This inefficiency directly undermines UN Sustainable Development Goals 13 (Climate Action) and 10 (Reduced Inequalities) by hindering equitable AI access in resource-constrained regions. To address this, we introduce EcoThink, an energy-aware adaptive inference framework designed to reconcile high-performance AI intelligence with environmental responsibility. EcoThink employs a lightweight, distillation-based router to dynamically assess query complexity, skipping unnecessary reasoning for factoid retrieval while reserving deep computation for complex logic. Extensive evaluations across 9 diverse benchmarks demonstrate that EcoThink reduces inference energy by 40.4% on average (up to 81.9% for web knowledge retrieval) without statistically significant performance loss. By mitigating algorithmic waste, EcoThink offers a scalable path toward a sustainable, inclusive, and energy-efficient generative AI Agent.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。