用VR+AI tutor在虚拟校园学印地语，实时对话互动。
Leveraging Virtual Reality and AI Tutoring for Language Learning: A Case Study of a Virtual Campus Environment with OpenAI GPT Integration with Unity 3D
- VR校园场景中嵌入GPT驱动的随行AI导师。
- 通过语音转文字、文本翻译、文字转语音实现实时交流。
- 适合语言学习者和教育科技研究者参考。
本文提出一种融合虚拟现实与AI辅导的多语言学习新方法，以印地语为例。基于Unity构建了包含本校11楼建筑的虚拟校园环境，其中集成由OpenAI GPT模型驱动的随行AI导师，通过API调用实现自然语言交互。系统利用语音转文字、文本转换与文字转语音技术，在联网条件下支持用户与导师的实时对话，提供沉浸式语言学习体验。该研究验证了将VR技术与AI Tutor结合用于语言教学的有效性与可行性。
原文摘要 · Abstract (English)
This paper presents a new approach to multiple language learning, with Hindi the language to be learnt in our case, by using the integration of virtual reality environments and AI enabled tutoring systems using OpenAIs GPT api calls. We have developed a scenario which has a virtual campus environment using Unity which focuses on a detailed representation of our universitys buildings 11th floor, where most of the cultural and technological activities take place. Within this virtual environment that we have created, we have an AI tutor powered by OpenAI's GPT model which was called using an api which moves around with the user. This provided language learning support in Hindi, as GPT is able to take care of language translation. Our approach mainly involves utilising speech to text, text to text conversion and text to speech capabilities to facilitate real time interaction between users and the AI tutor in the presence of internet. This research demonstrates the use of combining VR technology with AI tutoring for immersive language learning experiences and provides interaction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。