arXiv:2510.23487cs.AIcs.FL2025-10被引 1

用状态轨迹建模智能体行为,揭示其可验证的数学结构。

Are Agents Probabilistic Automata? A Trace-Based, Memory-Constrained Theory of Agentic AI

  • 将智能体视为带有限内存的随机控制器,通过轨迹语义分析交互行为。
  • 有界内存时轨迹语言为正则式,调用栈时为上下文无关式,无界内存时为递归可枚举式。
  • 适用于形式化验证,尤其适合关注安全性和概率风险的开发者与研究者。

本文研究标准智能体控制架构,通过轨迹语义与抽象方法推导其交互行为的自动机模型。将智能体实现建模为带有显式内存原语(如有界缓冲区、调用栈或读写外部内存)和随机策略(如大语言模型)的有限控制程序。不将具体智能体等同于确定性接受器,而是将智能体-环境闭合回路视为在有限交互轨迹上诱导出的概率分布。给定从具体配置到有限抽象状态空间的抽象函数,可得到概率轨迹语言和适用于概率模型检验的抽象概率转移模型 $M_{ ext{Abs}}$。通过施加显式、可审计的内存访问与控制流限制,证明所得轨迹语言的支持集在有界内存控制器下为正则式,在严格调用-返回控制器下为上下文无关式,在配备无界读写内存的控制器下为递归可枚举式。这些对应关系使得已有有限状态与下推系统验证方法得以复用,并精确刻画不可判定性边界。概率语义支持量化分析,例如:进入不安全抽象区域的概率是多少?在环境非确定性存在下,如何对这一概率进行上界估计。

原文摘要 · Abstract (English)

This paper studies standard controller architectures for agentic AI and derives automata-theoretic models of their interaction behavior via trace semantics and abstraction. We model an agent implementation as a finite control program augmented with explicit memory primitives (bounded buffers, a call stack, or read/write external memory) and a stochastic policy component (e.g., an LLM) that selects among architecturally permitted actions. Instead of equating the concrete agent with a deterministic acceptor, we treat the agent-environment closed loop as inducing a probability distribution over finite interaction traces. Given an abstraction function $\Abs$ from concrete configurations to a finite abstract state space, we obtain a probabilistic trace language and an abstract probabilistic transition model $M_{\Abs}$ suitable for probabilistic model checking. Imposing explicit, framework-auditable restrictions on memory access and control flow, we prove that the support of the resulting trace language is regular for bounded-memory controllers, context-free for strict call-return controllers, and recursively enumerable for controllers equipped with unbounded read/write memory. These correspondences allow the reuse of existing verification methods for finite-state and pushdown systems, and they delineate precisely when undecidability barriers arise. The probabilistic semantics leads to quantitative analyses such as: what is the probability of entering an unsafe abstract region, and how can we bound this probability in the presence of environment nondeterminism.

智能体形式化验证概率模型自动机理论

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。