arXiv:2605.15206cs.LGcs.AI2026-05被引 2

通过提前终止低成功率任务,减少本地AI代理的能耗

AgentStop: Terminating Local AI Agents Early to Save Energy in Consumer Devices

论文配图:AgentStop: Terminating Local AI Agents Early to Save Energy in Consumer Devices
图 1 · 摘自论文原文
  • 用令牌级概率等轻量信号预测任务失败,提前终止无望执行
  • 在复杂问答与编程任务中节省15%-20%能源,性能损失小于5%
  • 适合关注隐私保护与设备续航的本地AI应用开发者

基于大语言模型的自主智能体正被用于自动化编码、网页问答等多步骤任务。尽管云端部署存在隐私与连通性问题,但将代理部署在用户设备上可保障数据私密性并免除使用费用。然而,智能体工作流比普通LLM交互更耗资源,迭代推理、工具调用和失败重试显著增加令牌消耗,常导致大量计算浪费。本研究测量了本地部署智能体在消费级硬件上的时间、令牌与能耗开销,发现其相比单次推理负载明显提升GPU功耗、温度与电池消耗。为此,我们提出AgentStop——一种轻量级效率监控器,可基于低开销执行信号(如令牌级对数概率)预测并提前终止低成功率轨迹。实验显示,在挑战性网页问答与编程基准上,该方法能降低15%-20%的无效能耗,任务性能下降不足5%。结果表明,预测性早期终止是实现可持续、隐私友好型本地化智能体的有效手段。项目代码与数据已公开于https://github.com/brave-experiments/AgentStop。

原文摘要 · Abstract (English)

Autonomous agents powered by large language models (LLMs) are increasingly used to automate complex, multi-step tasks such as coding or web-based question answering. While remote, cloud-based agents offer scalability and ease of deployment, they raise privacy concerns, depend on network connectivity, and incur recurring API costs. Deploying agents locally on user devices mitigates these issues by preserving data privacy and eliminating usage-based fees. However, agentic workflows are far more resource-intensive than typical LLM interactions. Iterative reasoning, tool use, and failure retries substantially increase token consumption, often expending significant compute without successfully completing tasks. In this work, we investigate the time, token, and energy overhead of locally deployed LLM-based agents on consumer hardware. Our measurements show that agentic execution increases GPU power draw, temperature, and battery drain compared to single-inference workloads. To address this inefficiency, we introduce AgentStop, a lightweight efficiency supervisor that predicts and preemptively terminates trajectories unlikely to succeed. Leveraging low-cost execution signals, such as token-level log probabilities, AgentStop can reduce wasted energy by 15-20% with minimal impact on task performance (<5% utility drop) for challenging web-based question answering and coding benchmarks. These findings position predictive early termination as a practical mechanism for enabling sustainable, privacy-preserving LLM agents on user devices. Our project code and data are available at https://github.com/brave-experiments/AgentStop.

AI代理节能本地部署提示优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。