让3D虚拟人实时对话并根据用户情绪调整表达，提升沉浸感。
AVIN-Chat: An Audio-Visual Interactive Chatbot System with Emotional State Tuning
- 结合音视频的3D虚拟人实时交互，支持情感状态调节。
- 主观测试显示沉浸感显著优于纯文本或语音聊天系统。
- 适合需要高沉浸感的虚拟助手、教育陪练等场景。
本文提出一种音频-视觉交互式聊天机器人系统（AVIN-Chat），使用户能够与3D虚拟形象进行实时面对面交流。相较于以往仅提供文字或语音通信的聊天服务，该系统通过音视频同步输出，显著提升了用户体验质量。此外，系统能根据用户的心理状态动态调整语气与表情，实现情感化表达，增强用户与系统之间的情感联结，从而提高沉浸感。通过用户主观测试验证，本系统在沉浸感方面明显优于现有聊天机器人。演示视频见：https://www.youtube.com/watch?v=Z74uIV9k7_k。
原文摘要 · Abstract (English)
This work presents an audio-visual interactive chatbot (AVIN-Chat) system that allows users to have face-to-face conversations with 3D avatars in real-time. Compared to the previous chatbot services, which provide text-only or speech-only communications, the proposed AVIN-Chat can offer audio-visual communications providing users with a superior experience quality. In addition, the proposed AVIN-Chat emotionally speaks and expresses according to the user's emotional state. Thus, it enables users to establish a strong bond with the chatbot system, increasing the user's immersion. Through user subjective tests, it is demonstrated that the proposed system provides users with a higher sense of immersion than previous chatbot systems. The demonstration video is available at https://www.youtube.com/watch?v=Z74uIV9k7_k.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。