arXiv:2607.17948cs.AIcs.MA2026-07

用大模型替代部分决策,测试其对仿真可靠性与性能的影响。

Towards Agentic Agent-based Models: Feasibility, Performance, and Statistical Model Checking

论文配图:Towards Agentic Agent-based Models: Feasibility, Performance, and Statistical Model Checking
图 1 · 摘自论文原文
  • 在经典分隔模型中引入大模型代理,通过工具调用实现语义判断。
  • 小模型常因分类失败或工具调用崩溃导致不可用,大模型表现稳定。
  • 结合统计模型检测,可量化大模型对仿真结果的影响,适合行为研究者。

基于智能体的模型(ABMs)依赖于个体明确且可复现的决策规则,复杂集体行为由此涌现。近期大语言模型(LLMs)的发展使人们倾向于用其驱动的智能体能力替换、增强或扰动这些规则。然而,这引发方法论问题:引入基于大模型的决策如何影响仿真的可靠性、计算成本与行为?本文以流行的Mesa ABM库为基础,结合统计模型检查工具MultiVeStA,将经典谢林分隔模型扩展为混合群体:普通代理使用标准符号规则分类邻居,而一个代理通过工具调用将任务交由大模型处理。该代理接收邻居的自然语言描述,调用工具计数相似/不同邻居,据此决定是否满意。此设置提供了一个可控环境,用于研究大模型在决策中的语义、操作与计算特性。初步实验采用本地部署的不同规模大模型,发现较小模型在简单语义分类中易失败或在重复工具调用时失效,而较大模型通过了初步检验。研究还探讨了统计模型检查如何估计传统ABM可观测量,并量化引入智能体大模型组件对模型的影响。

原文摘要 · Abstract (English)

Agent-based models (ABMs) rely on simple, explicit and reproducible rules for individual decision making, while complex collective behavior emerges from interactions among agents. Recent advances in large language models (LLMs) make it tempting to replace, enrich, or perturb these rules with LLM-based agentic capabilities. However, this raises a methodological question: how does introducing LLM-driven decisions affect the reliability, computational cost, and behavior of ABM simulations? We investigate this for Mesa ABM models, a popular Python library for ABMs, analyzed by statistical model checking. Building on Mesa's integration with the statistical model checker MultiVeStA, we extend the classical Schelling segregation model with a hybrid population: ordinary agents classify neighbors using the standard symbolic rule, while one agent delegates this task to an LLM through tool calls. The LLM-enabled agent receives natural-language descriptions of neighboring agents and invokes tools that increment counters of similar/different neighbors; these counters determine its happiness according to the original Schelling dynamics. This provides a minimal but controlled setting where the semantic, operational, and computational behavior of LLM-based decisions can be studied inside an otherwise standard ABM. We report preliminary experiments with locally served LLMs of different sizes, showing that smaller models may fail simple semantic classification experiments or become operationally unusable during repeated tool-call generation, while larger tested models pass these preliminary checks. We discuss how statistical model checking can estimate classical ABM observables and quantify the impact of introducing agentic LLM components into simulation models.

智能体模型大模型应用仿真验证统计检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。