arXiv:2602.06025cs.CLcs.AI2026-02中稿 · ICML被引 9

让大模型代理按需分配内存预算,动态平衡性能与成本

Learning Query-Aware Budget-Tier Routing for Runtime Agent Memory

  • 将内存处理模块分三级预算,运行时智能路由选择
  • 在多个数据集上优于基线,在紧预算下仍保持高精度
  • 揭示三种预算策略的优劣,适合资源受限场景

大语言模型代理在超出单个上下文窗口时,内存越来越关键。然而现有系统多依赖离线、不感知查询的内存构建,效率低且可能丢弃关键信息。虽然运行时内存利用是自然选择,但以往方法开销大,难以控制性能-成本权衡。本文提出BudgetMem框架,实现显式、查询感知的性能-成本控制。该框架将内存处理划分为多个模块,每个模块提供低、中、高三档预算( extsc{Low}/ extsc{Mid}/ extsc{High}),由轻量级路由器基于强化学习训练的神经策略决定各模块的预算层级。我们通过统一测试平台研究三种实现方式:实现复杂度、推理行为和模块规模。在LoCoMo、LongMemEval和HotpotQA上,当侧重性能时(高预算),BudgetMem超越强基线;在紧预算下,更优地实现了准确率-成本权衡。分析还揭示了不同层级策略在各类预算下的优势与局限。

原文摘要 · Abstract (English)

Memory is increasingly central to Large Language Model (LLM) agents operating beyond a single context window, yet most existing systems rely on offline, query-agnostic memory construction that can be inefficient and may discard query-critical information. Although runtime memory utilization is a natural alternative, prior work often incurs substantial overhead and offers limited explicit control over the performance-cost trade-off. In this work, we present \textbf{BudgetMem}, a runtime agent memory framework for explicit, query-aware performance-cost control. BudgetMem structures memory processing as a set of memory modules, each offered in three budget tiers (i.e., \textsc{Low}/\textsc{Mid}/\textsc{High}). A lightweight router performs budget-tier routing across modules to balance task performance and memory construction cost, which is implemented as a compact neural policy trained with reinforcement learning. Using BudgetMem as a unified testbed, we study three complementary strategies for realizing budget tiers: implementation (method complexity), reasoning (inference behavior), and capacity (module model size). Across LoCoMo, LongMemEval, and HotpotQA, BudgetMem surpasses strong baselines when performance is prioritized (i.e., high-budget setting), and delivers better accuracy-cost frontiers under tighter budgets. Moreover, our analysis disentangles the strengths and weaknesses of different tiering strategies, clarifying when each axis delivers the most favorable trade-offs under varying budget regimes.

大模型代理内存管理预算控制强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。