打造可实时开展人机协作实验的开源平台,助力社会行为研究。
Deliberate Lab: A Platform for Real-Time Human-AI Social Experiments
- 构建支持多人实时互动的开放平台,整合人类与大语言模型作为平等参与者。
- 上线12个月服务88位研究者,覆盖9195名参与者,验证大规模可行性。
- 降低技术门槛,适合心理学、社会学及人机交互领域的研究者使用。
社会与行为科学家日益关注人类在人工智能协同下的互动、合作与决策行为。然而,相关实验基础设施仍不完善:(1) 缺乏支持大规模实时多主体实验的平台;(2) 多数部署需定制开发,限制复现性与可及性;(3) 现有工具未将AI代理视为核心参与方。本文提出Deliberate Lab,一个开源平台,支持大规模、实时的人机混合行为实验,同时兼容人类参与者与基于大语言模型(LLM)的智能体。我们报告了该平台为期12个月的公开部署数据(共88位研究者,9195名参与者),分析使用模式与工作流程,并结合用户案例与深度访谈。通过降低技术门槛并标准化混合人机实验支持,Deliberate Lab拓展了集体决策与以人为本的AI研究方法体系。
原文摘要 · Abstract (English)
Social and behavioral scientists increasingly aim to study how humans interact, collaborate, and make decisions alongside artificial intelligence. However, the experimental infrastructure for such work remains underdeveloped: (1) few platforms support real-time, multi-party studies at scale; (2) most deployments require bespoke engineering, limiting replicability and accessibility, and (3) existing tools do not treat AI agents as first-class participants. We present Deliberate Lab, an open-source platform for large-scale, real-time behavioral experiments that supports both human participants and large language model (LLM)-based agents. We report on a 12-month public deployment of the platform (N=88 experimenters, N=9195 experiment participants), analyzing usage patterns and workflows. Case studies and usage scenarios are aggregated from platform users, complemented by in-depth interviews with select experimenters. By lowering technical barriers and standardizing support for hybrid human-AI experimentation, Deliberate Lab expands the methodological repertoire for studying collective decision-making and human-centered AI.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。