测试AI在危机中引导人群撤离的沟通能力,发现定向通信更有效。
Guide Me Out: A Framework to Benchmark VLM Operators Communication in Crisis Scenarios

- 设计九张地图测试VLM在不同通信策略下的表现
- 定向发送比广播能降低40%以上失败率
- 视觉输入优于图结构,动态威胁显著增加风险
有效危机响应需要将语言指导与物理环境结合,考虑结构瓶颈、动态威胁和个体情境。现有NLP研究多局限于静态文本分类,忽视了AI操作员在动态具身场景中的沟通作用。本文提出一个新基准框架,评估视觉-语言模型(VLM)在模拟疏散中引导平民的能力。在九张结构复杂度不同的地图上,测试两种通信策略(定向/广播)、两种环境表示(视觉/图结构)、两种威胁行为(静止/移动)。结果表明:定向通信在所有难度下均显著降低平民失败率;视觉模态驱动性能提升,添加邻接图则因模型而异且常有害;移动威胁导致所有条件下失败率上升。这些发现表明,将VLM作为危机中的AI操作员仍面临重大挑战,通信策略与输入表示的选择直接影响干预成败。
原文摘要 · Abstract (English)
Effective crisis response requires spatially grounded communication that bridges linguistic guidance of civilians with the physical environment, accounting for structural bottlenecks, evolving threats, and agent-specific contexts. Yet, current NLP research in crisis communication remains mainly limited to static, text-only classification settings, overlooking the critical communicative role of AI operators in dynamic, embodied scenarios. We address this gap with a novel benchmarking framework for evaluating Vision-Language Models (VLMs) tasked with guiding civilian agents through simulated evacuations. We test two communication strategies (narrowcast vs. broadcast), two environment representations (visual vs. graph-based), and two threat behaviors (static vs. moving) across nine maps of varying structural complexity. Our results show that Narrowcast consistently reduces civilian Fail rates compared to Broadcast across all difficulty levels. Guidance quality depends heavily on how the VLM operator represents the world: the visual modality drives performance, while adding an adjacency graph is model-dependent and often harmful. Moving threats raise Fail rates across all conditions as communication must continuously adapt over time. Together, these findings show that deploying VLMs as AI operators in evacuation scenarios remains a non-trivial challenge, where the choice of communication strategy and input representation can directly determine the success or failure of the intervention.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。