arXiv:2601.01027cs.HCcs.AI2026-01International Conf…被引 4

打造可交互的虚拟角色平台,让数字人物能讲故事、有性格、会对话。

A Platform for Interactive AI Character Experiences

  • 整合对话、性格、记忆、语音、动画等技术,构建统一角色系统
  • 以爱因斯坦数字形象为例,实现沉浸式历史人物对话体验
  • 适合游戏、教育、文旅等需要拟人化互动的场景

从电影角色到现代科幻,让角色参与互动性叙事一直是跨代人的梦想。实现这一愿景面临诸多复杂挑战,包括对话理解、角色一致性、人格与情绪管理、知识与记忆处理、语音合成、动作生成、现实世界交互及物理环境集成。尽管基础模型、提示工程和微调技术已取得进展,但如何将这些技术融合用于交互角色仍是一大难题。本文提出一个系统级平台,可便捷设计可信的数字角色,支持对话与叙事驱动体验,并解决上述各项技术挑战。作为概念验证,我们构建了‘数字爱因斯坦’,用户可与其就生平、研究与个性展开对话。虽然该案例聚焦特定人物,但系统具备通用性,适用于任何叙事或对话驱动的角色。通过将多元AI组件统一为可快速适配的平台,本工作推动了沉浸式角色体验的发展,使逼真、故事化的交互成为现实。

原文摘要 · Abstract (English)

From movie characters to modern science fiction - bringing characters into interactive, story-driven conversations has captured imaginations across generations. Achieving this vision is highly challenging and requires much more than just language modeling. It involves numerous complex AI challenges, such as conversational AI, maintaining character integrity, managing personality and emotions, handling knowledge and memory, synthesizing voice, generating animations, enabling real-world interactions, and integration with physical environments. Recent advancements in the development of foundation models, prompt engineering, and fine-tuning for downstream tasks have enabled researchers to address these individual challenges. However, combining these technologies for interactive characters remains an open problem. We present a system and platform for conveniently designing believable digital characters, enabling a conversational and story-driven experience while providing solutions to all of the technical challenges. As a proof-of-concept, we introduce Digital Einstein, which allows users to engage in conversations with a digital representation of Albert Einstein about his life, research, and persona. While Digital Einstein exemplifies our methods for a specific character, our system is flexible and generalizes to any story-driven or conversational character. By unifying these diverse AI components into a single, easy-to-adapt platform, our work paves the way for immersive character experiences, turning the dream of lifelike, story-based interactions into a reality.

虚拟角色交互体验人工智能

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。