用虚拟操作玩出故事，AI实时生成叙事，让创作更自由
PlayWrite: A Multimodal System for AI Supported Narrative Co-Authoring Through Play in XR
- 用户直接操控虚拟角色和道具，通过动作触发叙事生成
- 将操作转化为可拖拽的叙事节点，再由大模型整合成完整故事
- 适合创意写作、游戏设计等需要即兴发挥的场景
当前基于文本提示的AI写作工具难以支持叙事中空间与交互特性，因为灵感常源于直接操作与试错。我们提出PlayWrite，一种混合现实系统，让用户通过直接操控虚拟角色和道具来创作故事。一个多元智能体管道将这些行为解析为“意图帧”——结构化的叙事片段，以可拖拽的“故事珠子”形式呈现于时间线上。大型语言模型随后将用户拼合的序列转化为最终叙事。13位来自不同领域的创作者参与用户研究，发现PlayWrite促进了高度即兴和玩乐式的创作过程。用户将AI视为协作伙伴，利用其意外反馈激发新点子并突破创作瓶颈。该系统展示了超越文本、以直接操作与玩乐为核心交互模式的共创意系统新路径。
原文摘要 · Abstract (English)
Current AI writing tools, which rely on text prompts, poorly support the spatial and interactive nature of storytelling where ideas emerge from direct manipulation and play. We present PlayWrite, a mixed-reality system where users author stories by directly manipulating virtual characters and props. A multi-agent AI pipeline interprets these actions into Intent Frames -structured narrative beats visualized as rearrangeable story marbles on a timeline. A large language model then transforms the user's assembled sequence into a final narrative. A user study (N=13) with writers from varying domains found that PlayWrite fosters a highly improvisational and playful process. Users treated the AI as a collaborative partner, using its unexpected responses to spark new ideas and overcome creative blocks. PlayWrite demonstrates an approach for co-creative systems that move beyond text to embrace direct manipulation and play as core interaction modalities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。