用沉浸式XR+AI打造多语言职业规划平台，让指导更生动直观。
XR-CareerAssist: An Immersive Platform for Personalised Career Guidance Leveraging Extended Reality and Multimodal AI
- 融合语音识别、机器翻译、视觉语言模型等五项AI技术，实现多模态交互。
- 基于10万+匿名职业数据生成动态职业路径图，用户满意度达78.3%。
- 适合高校职业中心、跨语言教育机构使用，提升互动体验与可及性。
传统职业指导平台依赖静态文本界面，难以吸引用户或提供个性化、有证据支持的建议。尽管计算机辅助职业指导系统自20世纪60年代发展至今，仍缺乏互动性，且忽视职业发展的叙事维度。我们提出XR-CareerAssist，一个将扩展现实（XR）与多种人工智能模块融合的沉浸式职业指导平台。系统集成自动语音识别实现语音交互，支持英语、希腊语、法语和意大利语的神经机器翻译，基于Langchain的对话式培训助手提供个性化对话，基于BLIP的视觉-语言模型生成职业可视化内容，并通过交互式3D虚拟形象以AWS Polly语音合成技术输出语音。职业轨迹以动态桑基图形式呈现，数据源自超过10万份匿名职业档案。平台基于Unity开发，适配Meta Quest 3，后端部署于AWS。在埃克塞特大学的试点评估中，23名参与者反馈语音识别准确率达95.6%，整体满意度为78.3%，系统响应性获91.3%的正面评价，反馈用于优化运动舒适度、音频清晰度与文字可读性。结果表明，XR与AI融合能显著提升职业指导的吸引力、可访问性与有效性，五项AI模块集成于单一沉浸环境，实现了区别于现有平台的多模态交互体验。
原文摘要 · Abstract (English)
Conventional career guidance platforms rely on static, text-driven interfaces that struggle to engage users or deliver personalised, evidence-based insights. Although Computer-Assisted Career Guidance Systems have evolved since the 1960s, they remain limited in interactivity and pay little attention to the narrative dimensions of career development. We introduce XR-CareerAssist, a platform that unifies Extended Reality (XR) with several Artificial Intelligence (AI) modules to deliver immersive, multilingual career guidance. The system integrates Automatic Speech Recognition for voice-driven interaction, Neural Machine Translation across English, Greek, French, and Italian, a Langchain-based conversational Training Assistant for personalised dialogue, a BLIP-based Vision-Language model for career visualisations, and AWS Polly Text-to-Speech delivered through an interactive 3D avatar. Career trajectories are rendered as dynamic Sankey diagrams derived from a repository of more than 100,000 anonymised professional profiles. The application was built in Unity for Meta Quest 3, with backend services hosted on AWS. A pilot evaluation at the University of Exeter with 23 participants returned 95.6% speech recognition accuracy, 78.3% overall user satisfaction, and 91.3% favourable ratings for system responsiveness, with feedback informing subsequent improvements to motion comfort, audio clarity, and text legibility. XR-CareerAssist demonstrates how the fusion of XR and AI can produce more engaging, accessible, and effective career development tools, with the integration of five AI modules within a single immersive environment yielding a multimodal interaction experience that distinguishes it from existing career guidance platforms.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。