arXiv:2601.22997cs.AIcs.SE2026-01被引 2

自动从执行日志构建状态抽象,提升智能体AI的可验证性

TriCEGAR: A Trace-Driven Abstraction Mechanism for Agentic AI

  • 基于执行轨迹学习谓词树自动构造状态抽象
  • 在线构建智能体行为马尔可夫决策过程,支持概率模型检验
  • 可检测异常行为,适合需要安全验证的AI系统开发

智能体AI通过工具执行任务,其行为依赖于长期、随机的交互轨迹,这使得保证其可靠性变得复杂,因为行为受非确定性环境和概率化模型输出影响。现有工作通过动态概率保障(DPA)实现运行时验证,即在线学习一个马尔可夫决策过程(MDP)并进行量化性质模型检验。但关键限制在于开发者需手动定义状态抽象,导致验证与应用特定启发式方法耦合,增加使用门槛。本文提出TriCEGAR,一种基于轨迹驱动的状态抽象机制,能从执行日志中自动构建状态,并支持在线构建智能体行为的MDP。TriCEGAR将抽象表示为从轨迹中学得并用反例优化的谓词树。我们设计了一个框架内实现,包含:(i) 捕获带类型的智能体生命周期事件,(ii) 从轨迹构建抽象,(iii) 构建MDP,(iv) 执行概率模型检验以计算如Pmax(成功)和Pmin(失败)等边界值。此外,我们还展示了运行可能性可用于作为护栏信号实现异常检测。

原文摘要 · Abstract (English)

Agentic AI systems act through tools and evolve their behavior over long, stochastic interaction traces. This setting complicates assurance, because behavior depends on nondeterministic environments and probabilistic model outputs. Prior work introduced runtime verification for agentic AI via Dynamic Probabilistic Assurance (DPA), learning an MDP online and model checking quantitative properties. A key limitation is that developers must manually define the state abstraction, which couples verification to application-specific heuristics and increases adoption friction. This paper proposes TriCEGAR, a trace-driven abstraction mechanism that automates state construction from execution logs and supports online construction of an agent behavioral MDP. TriCEGAR represents abstractions as predicate trees learned from traces and refined using counterexamples. We describe a framework-native implementation that (i) captures typed agent lifecycle events, (ii) builds abstractions from traces, (iii) constructs an MDP, and (iv) performs probabilistic model checking to compute bounds such as Pmax(success) and Pmin(failure). We also show how run likelihoods enable anomaly detection as a guardrailing signal.

智能体AI形式化验证状态抽象概率模型检验

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。