让儿童用AI和AR创作个性化互动角色，从使用者变创作者。
Empowering Children to Create AI-Enabled Augmented Reality Experiences
- 通过文本生成3D角色，自动绑定与追踪动作，支持可视化编程。
- 孩子可设计虚拟角色与真实物体互动，实现跨世界交互体验。
- 适合教育科技、儿童编程，激发创意表达与跨学科学习。
尽管具备提升儿童学习体验的潜力，当前的AI增强现实（AR）技术大多将儿童定位为消费者而非创造者。我们提出Capybara，一个基于AR和AI的视觉编程环境，使儿童能够创建、定制并编程叠加于物理世界之上的3D角色。该系统利用文本到3D生成模型，帮助儿童生成虚拟角色与配件，并通过自动骨骼绑定与身体追踪实现角色动画。此外，系统采用基于视觉的AI模型识别真实物体，使儿童可编程虚拟角色与周围环境的互动行为。我们通过一系列新颖的AR体验展示了Capybara的表现力。在美、阿两国共20名儿童的用户研究中，结果表明，Capybara能有效赋能儿童运用AI创作出个性化且富有吸引力的AR体验，无缝连接虚拟与现实世界。
原文摘要 · Abstract (English)
Despite their potential to enhance children's learning experiences, AI-enabled AR technologies are predominantly used in ways that position children as consumers rather than creators. We introduce Capybara, an AR-based and AI-powered visual programming environment that empowers children to create, customize, and program 3D characters overlaid onto the physical world. Capybara enables children to create virtual characters and accessories using text-to-3D generative AI models, and to animate these characters through auto-rigging and body tracking. In addition, our system employs vision-based AI models to recognize physical objects, allowing children to program interactive behaviors between virtual characters and their physical surroundings. We demonstrate the expressiveness of Capybara through a set of novel AR experiences. We conducted user studies with 20 children in the United States and Argentina. Our findings suggest that Capybara can empower children to harness AI in authoring personalized and engaging AR experiences that seamlessly bridge the virtual and physical worlds.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。