用Minecraft快速测试人机协作，通过回放分析促进双方认知同步。
Enabling Rapid Shared Human-AI Mental Model Alignment via the After-Action Review
- 基于浏览器的Minecraft环境，支持实时人机协同测试。
- 通过第一视角视频回放与GPT-4问答，实现任务后复盘分析。
- 适合研究人机协作、认知对齐及交互设计的学者与开发者。
本文提出两项推动人机协同（HMT）研究的新贡献：1）一个基于浏览器的Minecraft测试平台，可在连续空间、实时、部分可观测环境中快速测试协作型AI代理，无需繁琐的人机交互实验设置；2）一种帮助用户回顾并分析人机协同过程的工具，支持以第一人称视角回放人类与AI的行为视频，并通过集成GPT-4的聊天界面回答关于AI行为与模型细节的问题。由于Minecraft拥有庞大的玩家基础和丰富的预构建AI代理生态，该平台可加速新协作代理的设计与人类因素研究。该心理模型对齐工具通过可视化回放与智能问答，促进人机双方在任务后共同理解彼此行为逻辑，从而提升共享心智模型的建立效率。
原文摘要 · Abstract (English)
In this work, we present two novel contributions toward improving research in human-machine teaming (HMT): 1) a Minecraft testbed to accelerate testing and deployment of collaborative AI agents and 2) a tool to allow users to revisit and analyze behaviors within an HMT episode to facilitate shared mental model development. Our browser-based Minecraft testbed allows for rapid testing of collaborative agents in a continuous-space, real-time, partially-observable environment with real humans without cumbersome setup typical to human-AI interaction user studies. As Minecraft has an extensive player base and a rich ecosystem of pre-built AI agents, we hope this contribution can help to facilitate research quickly in the design of new collaborative agents and in understanding different human factors within HMT. Our mental model alignment tool facilitates user-led post-mission analysis by including video displays of first-person perspectives of the team members (i.e., the human and AI) that can be replayed, and a chat interface that leverages GPT-4 to provide answers to various queries regarding the AI's experiences and model details.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。