让智能体调度层遵循贝叶斯原则,提升决策可靠性。
Position: agentic AI orchestration should be Bayes-consistent
- 在智能体调度层引入贝叶斯推理,动态更新任务信念。
- 通过校准信念与效用感知策略,优化工具调用与资源分配。
- 适合关注人机协作与鲁棒决策的智能体系统开发者。
大语言模型在预测和复杂推理任务中表现优异,但许多高价值应用涉及不确定性下的决策,例如选择调用哪个工具、咨询哪位专家或投入多少资源。尽管将贝叶斯方法应用于大语言模型推理的可行性和实用性尚不明确,本文主张:智能体系统的控制层(负责协调大语言模型与工具)正是贝叶斯原则应发挥优势的领域。贝叶斯决策理论为智能体系统提供了框架,使其能够对任务相关的潜在变量保持信念,从观察到的智能体与人机交互中更新这些信念,并做出最优行动选择。让大语言模型本身成为显式的贝叶斯信念更新引擎,在计算上仍极为昂贵且概念上非平凡。相比之下,本文认为,一致的决策行为要求在智能体系统的调度层面采用贝叶斯原则,而非必须作用于大语言模型参数。本文阐述了适用于现代智能体系统与人机协作的贝叶斯控制的实际特性,并通过具体例子与设计模式展示:校准的信念与效用感知策略如何提升智能体调度的性能。
原文摘要 · Abstract (English)
LLMs excel at predictive tasks and complex reasoning tasks, but many high-value deployments rely on decisions under uncertainty, for example, which tool to call, which expert to consult, or how many resources to invest. While the usefulness and feasibility of Bayesian approaches remain unclear for LLM inference, this position paper argues that the control layer of an agentic AI system (that orchestrates LLMs and tools) is a clear case where Bayesian principles should shine. Bayesian decision theory provides a framework for agentic systems that can help to maintain beliefs over task-relevant latent quantities, to update these beliefs from observed agentic and human-AI interactions, and to choose actions. Making LLMs themselves explicitly Bayesian belief-updating engines remains computationally intensive and conceptually nontrivial as a general modeling target. In contrast, this paper argues that coherent decision-making requires Bayesian principles at the orchestration level of the agentic system, not necessarily the LLM agent parameters. This paper articulates practical properties for Bayesian control that fit modern agentic AI systems and human-AI collaboration, and provides concrete examples and design patterns to illustrate how calibrated beliefs and utility-aware policies can improve agentic AI orchestration.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。