让机器人懂情绪、记过往、会手势，更贴心地辅导学生。
Integrating emotional intelligence, memory architecture, and gestures to achieve empathetic humanoid robot interaction in an educational setting
- 用多模态大模型整合情绪、记忆与手势，构建拟人化智能核心。
- 引入情感交互向量评估，实测表明学生参与度和学习效果显著提升。
- 适合教育机器人研发者、人机交互研究者参考，推动智能辅导落地。
本研究探索将情绪智能、记忆驱动个性化与非语言交互等人类特质协同集成到一个情感自适应的教育机器人导师系统中，旨在提升学生参与度与学习成效，并通过情感交互向量（Engagement Vector）进行量化评估。尽管先前的人机交互（HRI）研究已分别探讨过这些特质，但尚未将其同步整合为可运行的教育框架。为此，我们基于Meta的多模态大模型LLaMa 3.2，部署了情绪、记忆与手势模块，构建了具备类人情感系统、记忆架构与动作控制能力的AI代理系统。该系统可识别并响应学生的实时情绪状态，回顾其过往学习记录，动态调整互动风格，并通过同步手势传递个性化语言反馈。实验采用情感交互向量模型评估交互质量，定量与定性结果均表明：相比缺乏拟人特质的基线机器人，该系统显著提升了学生参与度与学习成果，验证了具共情能力的机器人导师能创造更具支持性与互动性的学习体验，最终带来更优的学习成效。
原文摘要 · Abstract (English)
This study investigates the integration of individual human traits into an empathetically adaptive educational robot tutor system designed to improve student engagement and learning outcomes with corresponding Engagement Vector measurement. While prior research in the field of Human-Robot Interaction (HRI) has examined the integration of the traits, such as emotional intelligence, memory-driven personalization, and non-verbal communication, by themselves, they have thus-far neglected to consider their synchronized integration into a cohesive, operational education framework. To address this gap, we customize a Multi-Modal Large Language Model (LLaMa 3.2 from Meta) deployed with modules for human-like traits (emotion, memory and gestures) into an AI-Agent framework. This constitutes to the robot's intelligent core mimicing the human emotional system, memory architecture and gesture control to allow the robot to behave more empathetically while recognizing and responding appropriately to the student's emotional state. It can also recall the student's past learning record and adapt its style of interaction accordingly. This allows the robot tutor to react to the student in a more sympathetic manner by delivering personalized verbal feedback synchronized with relevant gestures. Our study investigates the extent of this effect through the introduction of Engagement Vector Model which can be a surveyor's pole for judging the quality of HRI experience. Quantitative and qualitative results demonstrate that such an empathetic responsive approach significantly improves student engagement and learning outcomes compared with a baseline humanoid robot without these human-like traits. This indicates that robot tutors with empathetic capabilities can create a more supportive, interactive learning experience that ultimately leads to better outcomes for the student.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。