arXiv:2604.09881eess.AScs.HC2026-04

用学生自控任务中的语音感知情绪,提升远程学习体验。

Toward using Speech to Sense Student Emotion in Remote Learning Environments

论文配图:Toward using Speech to Sense Student Emotion in Remote Learning Environments
图 1 · 摘自论文原文
  • 通过自控任务采集语音,分析情绪三维度变化
  • 语音可有效反映情绪波动,自动预测准确率显著
  • 适合教育科技、智能教学系统开发者参考

随着多模态通信技术的发展,远程学习环境(如远程大学)日益普及。由于远程学习通常为异步进行,缺乏面对面教学中充足的情绪线索,难以营造愉悦的学习体验。受语音副语言处理领域在情绪预测方面进展的启发,本文探索利用语音感知学生情绪,基于自控任务构建的语音数据展开研究。具体探究两个问题:(a) 自控任务中获取的语音是否在效价、唤醒度和支配感维度上呈现可感知变化?(b) 这些情绪维度的变化能否被自动预测?研究通过构建包含自发单人独白语音的数据集,并开展主观听觉评估与自动情绪维度预测实验予以回答。结果表明,基于自控任务的语音可作为感知远程学习中学生情绪的有效手段,为将副语言语音处理技术无缝融入远程学习流程,实现教学设计优化与反馈生成提供了新路径。

原文摘要 · Abstract (English)

With advancements in multimodal communication technologies, remote learning environments such as, distance universities are increasing. Remote learning typically happens asynchronously. As a consequence, unlike face-to-face in-person classroom teaching, this lacks availability of sufficient emotional cues for making learning a pleasant experience. Motivated by advances made in the paralinguistic speech processing community on emotion prediction, in this paper we explore use of speech for sensing students' emotions by building upon speech-based self-control tasks developed to aid effective remote learning. More precisely, we investigate: (a) whether speech acquired through self-control tasks exhibit perceptible variation along valence, arousal, and dominance dimensions? and (b) whether those dimensional emotion variations can be automatically predicted? We address these two research questions by developing a dataset containing spontaneous monologue speech acquired as open responses to self-control tasks and by carrying out subjective listener evaluations and automatic dimensional emotion prediction studies on that dataset. Our investigations indicate that speech-based self-control tasks can be a means to sense student emotion in remote learning environment. This opens potential venues to seamlessly integrate paralinguistic speech processing technologies in the remote learning loop for enhancing learning experiences through instructional design and feedback generation.

情绪识别远程教育语音分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。