Kahaani用AI帮孩子共创故事，玩中学英语和叙事逻辑。
Kahaani: A Multimodal Co-Creative Storytelling System
- 结合大模型与音视频生成，让孩子和AI共同创作故事。
- 基于弗雷塔格金字塔和普罗普功能框架构建故事结构。
- 适合想提升英语、创造力与叙事能力的儿童及家长。
本文介绍Kahaani——一个面向儿童的多模态协同创作讲故事系统，旨在通过生成式人工智能维持孩子的参与度，促进教育性叙事体验。其中‘协同创作’指孩子与Kahaani共同贡献故事内容。系统融合大型语言模型（LLM）、文本转语音（TTS）、文本转音乐（TTM）和文本转视频（TTV）生成技术，打造丰富、沉浸且可访问的叙事体验。创作过程基于两种经典叙事框架：弗雷塔格金字塔（Freytag's Pyramid）与普罗普叙事功能（Propp's Narrative Functions）。主要目标包括：(1) 帮助儿童提升英语能力；(2) 通过故事寓意传递重要人生道理；(3) 让孩子理解故事结构，全程寓教于乐。我们评估了各AI组件性能，并通过三组亲子用户研究，验证系统的整体体验与教育价值。
原文摘要 · Abstract (English)
This paper introduces Kahaani, a multimodal, co-creative storytelling system that leverages Generative Artificial Intelligence, designed for children to address the challenge of sustaining engagement to foster educational narrative experiences. Here we define co-creative as a collaborative creative process in which both the child and Kahaani contribute to the generation of the story. The system combines Large Language Model (LLM), Text-to-Speech (TTS), Text-to-Music (TTM), and Text-to-Video (TTV) generation to produce a rich, immersive, and accessible storytelling experience. The system grounds the co-creation process in two classical storytelling framework, Freytag's Pyramid and Propp's Narrative Functions. The main goals of Kahaani are: (1) to help children improve their English skills, (2) to teach important life lessons through story morals, and (3) to help them understand how stories are structured, all in a fun and engaging way. We present evaluations for each AI component used, along with a user study involving three parent-child pairs to assess the overall experience and educational value of the system.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。