让语言模型在不改权重的情况下持续学习,还能避免任务间干扰。
RIZZ: Routing Interactions to Near Zero-Interference Zones for Continual Adaptation of Black-Box Agents

- 通过验证器控制的记忆路由机制,动态生成任务专用记忆分支。
- 仅在输出被验证后才更新记忆,有效防止错误行为传播。
- 适合需要在线适应、资源受限的长期运行智能体场景。
大型语言模型正作为长期运行的智能体部署,需在无模型权重访问的情况下适应用户、任务、领域、模态和反馈模式的变化。现有黑箱适应方法通常仅优化单一提示词、维护统一记忆或依赖高开销的滚动搜索,但在输入流非平稳、反馈稀疏、任务间失败易污染时表现不佳。我们提出RIZZ(Routing Interactions to Near Zero-interference Zones),一种面向复合语言模型系统的持续适应框架,完全通过验证器门控的记忆、路由与提示编译实现。RIZZ将输入流组织为动态生成的记忆分支,在推理时根据上下文选择或创建分支,检索局部、全局、图结构化及工作内存信息,结合任务证据编译成有限提示。模型执行后,任务验证器评估输出,仅经验证的交互可更新记忆、推广可复用规则、降级有害规则或创建反模式。该机制使黑箱智能体在持续自然语言反馈中提升,同时显式控制任务间干扰。RIZZ针对需在上下文预算内在线适应的场景。我们在竞争性基准上证明其优于当前最优基线。
原文摘要 · Abstract (English)
Large language models are increasingly deployed as long-lived agents that must adapt across users, tasks, domains, modalities, and feedback regimes without access to model weights. Existing black-box adaptation methods typically optimize a single prompt, maintain an undifferentiated memory, or rely on repeated rollout-heavy search. However, these designs struggle when streams of input are nonstationary, feedback is sparse, and failures from one task family can contaminate behavior on another. We introduce RIZZ (Routing Interactions to Near Zero-interference Zones), a continual adaptation framework for compound language-model systems that learns entirely through verifier-gated memory, routing, and prompt compilation. RIZZ organizes input streams into dynamically spawned memory branches. At inference time, either while online or offline, a context-aware router selects or creates a branch that retrieves branch-local, global, graph-structured, and working-memory context, which is compiled into a bounded prompt together with retrieved task evidence. After the model acts, task verifiers score the output, and only verified interactions can update memory, promote reusable rules, demote harmful rules, or create anti-patterns. This yields a black-box agent that improves through persistent natural-language feedback while explicitly controlling interference. RIZZ targets the regime where adaptation must occur online under context budgets. Finally, we demonstrate the effectiveness of our framework against state-of-the-art baselines on competitive benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。