arXiv:2606.08348cs.CL2026-06

用贝叶斯推理动态优化大模型智能体的技能,提升可靠性与可审计性。

Bayesian-Agent: Posterior-Guided Skill Evolution Across LLM Agent Harnesses

  • 将技能视为贝叶斯证据,基于验证轨迹更新可靠性和失效模式信念
  • 在RealFin-Bench上性能超传统经验率方法,增量修复使准确率提升20个百分点
  • 适用于多类智能体框架,适合需高可靠性的长期运行系统

大模型智能体依赖提示、工具、记忆、标准操作流程、技能及反馈,但现有自演化路径常通过启发式反思或原始成功次数更新,当轨迹稀疏、昂贵且依赖上下文时易失效。本文提出贝叶斯-智能体(Bayesian-Agent),一种原生跨智能体框架,将可复用技能视为贝叶斯证据对象。该框架记录已验证轨迹,维护对技能可靠性与失效模式的后验信念,并将这些信念转化为可审计的技能动作与面向模型的约束机制。这一后验视角提供了有限样本下替代原始经验率更新的方法,同时将提示、上下文与智能体工程建模为对外部决策环境的推断。在RealFin-Bench上,贝叶斯技能演化匹配或优于原始经验率控制,在原生运行中表现更优;在增量模式下,其修复使SOP-Bench从80%提升至95%,Lifelong AgentBench从90%提升至100%,RealFin-Bench从45%提升至65%。后端与模型缩放消融实验表明,只要智能体框架能生成可验证任务成果,后验引导修复可在BA native、MiniSWEAgent和Claude Code间通用。代码已开源:https://github.com/DataArcTech/Bayesian-Agent。

原文摘要 · Abstract (English)

LLM agents increasingly rely on prompts, tools, memory, SOPs, skills, and harness feedback, yet current self-evolution pipelines often update these assets through heuristic reflection or raw success counts. Such updates are brittle when trajectories are sparse, expensive, and context-dependent. We introduce Bayesian-Agent, a native and cross-harness framework that treats reusable agent skills as Bayesian evidence objects. Bayesian-Agent records verified trajectories, maintains posterior beliefs over skill reliability and failure modes, and turns those beliefs into auditable skill actions and model-facing guardrails. This posterior view provides a finite-sample alternative to raw empirical-rate skill updates and frames prompt, context, and harness engineering as inference over the external decision environment. On RealFin-Bench, Bayesian skill evolution matches or improves the raw empirical-rate control and yields large gains on native runs. In the incremental mode, incremental repair improves SOP-Bench from 80\% to 95\%, Lifelong AgentBench from 90\% to 100\%, and RealFin-Bench from 45\% to 65\%. Backend and model-scaling ablations further show that posterior-guided repair can operate across BA native, MiniSWEAgent, and Claude Code, provided the harness produces verifiable task artifacts. The source code is available at https://github.com/DataArcTech/Bayesian-Agent.

大模型智能体贝叶斯推理技能演化可审计性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。