arXiv:2601.05529cs.AIcs.RO2026-01AAAI被引 1

高成功率不等于可靠决策,基础模型导航仍存致命缺陷。

Before We Trust Them: Decision-Making Failures in Navigation of Foundation Models

  • 设计六项诊断任务,分三类场景测试模型决策能力
  • GPT-5在未知区域路径规划中失败率高达7%,暴露空间结构理解缺失
  • 新模型未必更可靠,安全任务中旧模型反而表现更优

导航任务的高成功率未必反映模型具备可靠的决策能力。我们通过六项诊断任务,在三种场景下评估当前模型:完全空间信息、不完整空间信息和安全相关信息推理。结果表明,现有指标可能掩盖关键局限性,误导性能判断。在未知单元格路径规划任务中,GPT-5成功率达93%,但失败案例暴露出缺乏结构性空间理解等根本缺陷。在安全相关任务中,Gemini-2.5 Flash在紧急疏散任务上仅达67%,低于前代Gemini-2.0 Flash的100%。所有评估中,模型均出现结构坍塌、幻觉推理、约束违背和危险决策。这些发现表明,基础模型在导航决策中仍存在显著失败,需精细化评估方可信任。

原文摘要 · Abstract (English)

High success rates on navigation-related tasks do not necessarily translate into reliable decision making by foundation models. To examine this gap, we evaluate current models on six diagnostic tasks spanning three settings: reasoning under complete spatial information, reasoning under incomplete spatial information, and reasoning under safety-relevant information. Our results show that the current metrics may not capture critical limitations of the models and indicate good performance, underscoring the need for failure-focused analysis to understand model limitations and guide future progress. In a path-planning setting with unknown cells, GPT-5 achieved a high success rate of 93%; Yet, the failed cases exhibit fundamental limitations of the models, e.g., the lack of structural spatial understanding essential for navigation. We also find that newer models are not always more reliable than their predecessors on this end. In reasoning under safety-relevant information, Gemini-2.5 Flash achieved only 67% on the challenging emergency-evacuation task, underperforming Gemini-2.0 Flash, which reached 100% under the same condition. Across all evaluations, models exhibited structural collapse, hallucinated reasoning, constraint violations, and unsafe decisions. These findings show that foundation models still exhibit substantial failures in navigation-related decision making and require fine-grained evaluation before they can be trusted.

导航决策模型缺陷安全评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。