arXiv:2505.21604cs.CYcs.AI2025-05

构建安全实验平台,研究人与AI在数字对话中的互动行为

Public Discourse Sandbox: Facilitating Human and AI Digital Communication Research

  • 搭建受控数字对话环境,支持人-AI与AI-AI交互研究
  • 通过提示工程等技术模拟定制AI参与者,评估其影响
  • 开源平台供学术界使用,解决数据与伦理难题

社交媒体是重大事件、娱乐及小众话题讨论的主要交流与信息传播平台,对研究者理解各类社会议题具有重要价值。然而,获取真实数据面临困难、成本高且常受机器人账号和虚假内容干扰。此外,在未告知用户的情况下开展在线实验也存在伦理风险。亟需更可控、可扩展的机制来评估数字对话干预的影响。本文提出公共话语沙盒(Public Discourse Sandbox, PDS),一个用于人-人工智能及人工智能-人工智能对话研究、测试与训练的数字对话平台。PDS为无法在公开商业社交平台进行的研究实验提供安全可靠的空间,支持通过提示工程、检索增强生成(RAG)和微调等技术,探究AI行为及其对受众的影响。我们提供托管的实时版本以支持研究人员,并在GitHub上开源代码,促进社区协作与贡献。

原文摘要 · Abstract (English)

Social media serves as a primary communication and information dissemination platform for major global events, entertainment, and niche or topically focused community discussions. Therefore, it represents a valuable resource for researchers who aim to understand numerous questions. However, obtaining data can be difficult, expensive, and often unreliable due to the presence of bots, fake accounts, and manipulated content. Additionally, there are ethical concerns if researchers decide to conduct an online experiment without explicitly notifying social media users about their intent. There is a need for more controlled and scalable mechanisms to evaluate the impacts of digital discussion interventions on audiences. We introduce the Public Discourse Sandbox (PDS), which serves as a digital discourse research platform for human-AI as well as AI-AI discourse research, testing, and training. PDS provides a safe and secure space for research experiments that are not viable on public, commercial social media platforms. Its main purpose is to enable the understanding of AI behaviors and the impacts of customized AI participants via techniques such as prompt engineering, retrieval-augmented generation (RAG), and fine-tuning. We provide a hosted live version of the sandbox to support researchers as well as the open-sourced code on GitHub for community collaboration and contribution.

AI交互对话研究实验平台

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。