arXiv:2504.01924cs.GRcs.LG2025-04被引 3

用大模型生成虚拟世界中的智能人群,让群体行为更自然真实。

Gen-C: Populating Virtual Worlds with Generative Crowds

  • 用LLM自动生成合成人群数据,省去人工标注
  • 提出时间扩展图结构,同时建模动作、交互与空间关系
  • 可生成多样且连贯的群体行为,适合场景模拟与游戏开发

过去二十年,研究人员在基于代理的人群模拟方面取得了显著进展,但多数工作仍局限于碰撞回避、路径跟随和群体聚集等底层任务。因此,这些方法难以捕捉长期人-人与人-环境互动中涌现出的高层行为。我们提出生成式人群框架Gen-C,能够生成体现人-人与人-环境互动的群体场景,并形成连贯的高层人群规划。为避免收集和标注真实人群视频数据的高成本,我们利用大语言模型(LLM)自动生成合成人群数据集。为表示这些场景,我们提出一种时间扩展图结构,编码动作、交互与空间上下文。Gen-C采用双变分图自编码器(VGAE)架构,联合学习连接模式与节点特征,条件于文本与结构信号,克服了直接使用LLM生成的局限性,实现可扩展、环境感知的多智能体人群模拟。我们在大学校园和火车站等多样化场景中验证了该框架的有效性,结果表明其能生成异质人群、连贯交互以及符合上下文的高层决策模式。

原文摘要 · Abstract (English)

Over the past two decades, researchers have made significant steps in simulating agent-based human crowds, yet most efforts remain focused on low-level tasks such as collision avoidance, path following, and flocking. As a result, these approaches often struggle to capture the high-level behaviors that emerge from sustained agent-agent and agent-environment interactions over time. We introduce Generative Crowds (Gen-C), a generative framework that produces crowd scenarios capturing agent-agent and agent-environment interactions, shaping coherent high-level crowd plans. To avoid the labor-intensive process of collecting and annotating real crowd video data, we leverage Large Language Models (LLMs) to bootstrap synthetic datasets of crowd scenarios. To represent those scenarios, we propose a time-expanded graph structure encoding actions, interactions, and spatial context. Gen-C employs a dual Variational Graph Autoencoder (VGAE) architecture that jointly learns connectivity patterns and node features conditioned on textual and structural signals, overcoming the limitations of direct LLM generation to enable scalable, environment-aware multi-agent crowd simulations. We demonstrate the effectiveness of our framework on scenarios with diverse behaviors such as a University Campus and a Train Station, showing that it generates heterogeneous crowds, coherent interactions, and high-level decision-making patterns consistent with the provided context.

人群模拟生成模型多智能体大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。