用幻觉诊断空间认知摩擦，让环境会思考。
From Particles to Agents: Hallucination as a Metric for Cognitive Friction in Spatial Simulation
- 用大模型模拟空间中智能体的语义预期，替代传统物理粒子。
- 发现幻觉可暴露空间设计中的语义模糊点（即‘幽灵可用性’）。
- 适合做人机协同设计、智能建筑与交互式数字孪生的研究者。
传统建筑仿真（如计算流体动力学、疏散模拟、结构分析）将元素建模为基于物理的确定性‘粒子’，而非具认知能力的‘智能体’。为此，我们提出‘代理式环境仿真’，利用大型多模态生成模型根据语义预期主动预测空间环境的下一步状态。结合无障碍增强现实流程和多模态数字孪生案例，我们主张从时间步进转向‘情景化空间推理’，仿真以有意义、由意外触发的事件推进。在此框架下，我们将人工智能幻觉视为诊断工具。通过形式化定义‘认知摩擦’（C_f），可揭示‘幽灵可用性’——即建筑空间中的语义歧义。最后，我们挑战现有人机交互范式，将环境视作动态认知伙伴，提出一种以人为本的认知协调框架，用于设计保持自主性、情感清晰度和认知完整性的AI驱动仿真。
原文摘要 · Abstract (English)
Traditional architectural simulations (e.g. Computational Fluid Dynamics, evacuation, structural analysis) model elements as deterministic physics-based "particles" rather than cognitive "agents". To bridge this, we introduce \textbf{Agentic Environmental Simulations}, where Large Multimodal generative models actively predict the next state of spatial environments based on semantic expectation. Drawing on examples from accessibility-oriented AR pipelines and multimodal digital twins, we propose a shift from chronological time-steps to Episodic Spatial Reasoning, where simulations advance through meaningful, surprisal-triggered events. Within this framework we posit AI hallucinations as diagnostic tools. By formalizing the \textbf{Cognitive Friction} ($C_f$) it is possible to reveal "Phantom Affordances", i.e. semiotic ambiguities in built space. Finally, we challenge current HCI paradigms by treating environments as dynamic cognitive partners and propose a human-centered framework of cognitive orchestration for designing AI-driven simulations that preserve autonomy, affective clarity, and cognitive integrity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。