孩子用日常物品和语言互动，指挥机器人演戏。
BotDirector: Robot Storytelling Across the Symmetrical Reality with Multi-modal Interactions
- 孩子用实物摆场景，通过对话生成故事
- 故事自动转为机器人动作序列并由集群执行
- 适合儿童创意表达，无需编程知识
机器人讲故事融合技术创新与创意表达，能以全新方式吸引儿童。但技术门槛常让儿童难以参与。我们提出一种交互系统，支持儿童通过实体物件摆放和自然语言进行机器人叙事。孩子自主布置游戏场景，结合大语言模型生成故事内容。故事基于场景地图与角色信息转化为运动序列，由具备自主导航能力的集群机器人执行。该系统实现灵活叙事场景，使幼儿可利用日常物品创作机器人剧目，突破传统技术限制。
原文摘要 · Abstract (English)
Robot storytelling offers a unique blend of technological innovation and creative expression that engages children in unprecedented ways. However, the technical aspects are often too complicated for children. We propose an interactive system that facilitates robot storytelling with tangible and natural language interactions. Children arrange the playground with their own stuff and create narratives with an LLM agent. The created narratives are transformed into a motion sequence based on the map and characters, and the motions are executed by self-navigating swarm robots. This system enhances robot storytelling with flexible scenarios, enabling young children to create robot dramas with everyday objects.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。