用双智能体框架让大模型更像真实乘客,持续学习路线调整行为。
Aligning LLM agents with human learning and adjustment behavior: a dual agent approach
- 构建记忆+可学人格的双智能体,模拟人类出行者动态决策。
- 在真实路网实验中,个体与群体模拟精度均显著优于现有方法。
- 不仅模仿行为,还捕捉学习过程演化,适合交通规划与政策评估。
有效建模人类旅客如何通过与交通系统互动来学习和调整出行行为,对系统评估与规划至关重要。然而,由于该行为涉及复杂的认知与决策过程,建模难度较大。近年来研究开始利用大语言模型(LLM)智能体完成此任务。本文提出一种新型双智能体框架,实现LLM智能体与真实旅客在在线数据流中的持续学习与行为对齐。该框架包含一组配备记忆系统与可学习人格的LLM旅客智能体,作为人类旅客的仿真器;同时引入一个LLM校准智能体,利用大模型的推理与分析能力来训练旅客智能体的人格。两者协同工作,旨在追踪并对齐旅客的底层决策机制,生成真实且自适应的仿真结果。基于真实世界日间路径选择实验数据集,实验表明本方法在个体行为对齐与宏观仿真准确率上均显著优于现有基于LLM的方法。此外,证明该方法超越简单行为模仿,能捕捉底层学习过程的演变,实现更深层次的对齐,从而提升泛化能力。总体而言,本框架为构建自适应、行为真实的出行者仿真智能体提供了新范式,有助于交通仿真与政策分析。
原文摘要 · Abstract (English)
Effective modeling of how human travelers learn and adjust their travel behavior from interacting with transportation systems is critical for system assessment and planning. However, this task is also difficult due to the complex cognition and decision-making involved in such behavior. Recent research has begun to leverage Large Language Model (LLM) agents for this task. Building on this, we introduce a novel dual-agent framework that enables continuous learning and alignment between LLM agents and human travelers on learning and adaptation behavior from online data streams. Our approach involves a set of LLM traveler agents, equipped with a memory system and a learnable persona, which serve as simulators for human travelers. To ensure behavioral alignment, we introduce an LLM calibration agent that leverages the reasoning and analytical capabilities of LLMs to train the personas of these traveler agents. Working together, this dual-agent system is designed to track and align the underlying decision-making mechanisms of travelers and produce realistic, adaptive simulations. Using a real-world dataset from a day-to-day route choice experiment, we show our approach significantly outperforms existing LLM-based methods in both individual behavioral alignment and aggregate simulation accuracy. Furthermore, we demonstrate that our method moves beyond simple behavioral mimicry to capture the evolution of underlying learning processes, a deeper alignment that fosters robust generalization. Overall, our framework provides a new approach for creating adaptive and behaviorally realistic agents to simulate travelers' learning and adaptation that can benefit transportation simulation and policy analysis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。