用隐式优化提升语言代理在高风险场景中的行为真实度
Implicit Behavioral Alignment of Language Agents in High-Stakes Crowd Simulations

- 基于人物-环境对齐框架,通过迭代优化角色设定来隐式调整行为
- 在枪击模拟中降低84%行为分布偏差,优于显式指令基线34%
- 生成的角色可泛化到新场景,适合高可靠性社会仿真应用
语言驱动的生成代理已推动大规模社会仿真发展,广泛应用于人际训练与全球政策制定。然而,近期研究发现生成代理的行为常偏离专家预期与真实数据——我们称之为行为-现实差距。为此,本文提出基于勒温行为方程的理论框架Persona-Environment Behavioral Alignment(PEBA),将行为对齐建模为分布匹配问题。基于此,提出名为PersonaEvolve(PEvo)的基于大模型的优化算法,通过迭代优化代理人格,隐式使其集体行为在特定环境背景下贴近真实专家基准。我们在自建的持械袭击事件模拟中验证了PEvo,相比无引导情形,平均降低84%分布差异;相较于显式指令基线,改进34%。结果还显示,经PEvo优化的人格具备跨场景泛化能力。该方法显著提升高风险社会仿真中的行为真实性和可靠性。更广泛而言,PEBA-PEvo框架为构建可信的大型语言模型驱动社会仿真提供了原则性路径。
原文摘要 · Abstract (English)
Language-driven generative agents have enabled large-scale social simulations with transformative uses, from interpersonal training to aiding global policy-making. However, recent studies indicate that generative agent behaviors often deviate from expert expectations and real-world data--a phenomenon we term the Behavior-Realism Gap. To address this, we introduce a theoretical framework called Persona-Environment Behavioral Alignment (PEBA), formulated as a distribution matching problem grounded in Lewin's behavior equation stating that behavior is a function of the person and their environment. Leveraging PEBA, we propose PersonaEvolve (PEvo), an LLM-based optimization algorithm that iteratively refines agent personas, implicitly aligning their collective behaviors with realistic expert benchmarks within a specified environmental context. We validate PEvo in an active shooter incident simulation we developed, achieving an 84% average reduction in distributional divergence compared to no steering and a 34% improvement over explicit instruction baselines. Results also show PEvo-refined personas generalize to novel, related simulation scenarios. Our method greatly enhances behavioral realism and reliability in high-stakes social simulations. More broadly, the PEBA-PEvo framework provides a principled approach to developing trustworthy LLM-driven social simulations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。