多人实时协作用AI共建虚拟3D世界,探索社交互动对创作的影响
Social Conjuring: Multi-User Runtime Collaboration with AI in Building Virtual 3D Worlds
- 支持多人通过社交、工具与空间推理交互,实时共创动态3D场景
- 12人预实验表明社交语境显著影响空间环境的提示生成方式
- 适合研究人机协同设计、VR创意协作及社交化内容生成的开发者
生成式人工智能在激发虚拟世界生成方面展现出潜力,但其作为社交互动过程的理解仍较少。本文提出 Social Conjurer 框架,支持多用户在实时环境中协作构建与修改虚拟3D世界。通过扩展社交互动、工具使用及空间推理等交互方式,该框架促进了丰富多样的虚拟环境生成。一项初步用户研究(N=12)揭示了该方法的用户体验,社交背景如何塑造空间环境的提示方式,并为基于提示的3D协同创作的社会应用提供见解。本研究不仅展示了AI支持的多用户世界创建潜力,还为将AI模型融入三维内容生成的人性化界面设计提供了新路径。
原文摘要 · Abstract (English)
Generative artificial intelligence has shown promise in prompting virtual worlds into existence, yet little attention has been given to understanding how this process unfolds as social interaction. We present Social Conjurer, a framework for AI-augmented dynamic 3D scene co-creation, where multiple users collaboratively build and modify virtual worlds in real-time. Through an expanded set of interactions, including social and tool-based engagements as well as spatial reasoning, our framework facilitates the creation of rich, diverse virtual environments. Findings from a preliminary user study (N=12) provide insight into the user experience of this approach, how social contexts shape the prompting of spatial environments, and perspective on social applications of prompt-based 3D co-creation. In addition to highlighting the potential of AI-supported multi-user world creation and offering new pathways for AI-augmented creative processes in VR, this article presents a set of implications for designing human-centered interfaces that incorporate AI models into 3D content generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。