情绪标注未必能反映记忆度,智能系统需重新评估情感数据的可靠性。
The Emotion-Memory Link: Do Memorability Annotations Matter for Intelligent Systems?
- 在真实对话场景中连续标注情绪与记忆度,检验二者关联性。
- 结果显示情绪与记忆度的相关性接近随机水平,无显著关系。
- 提醒研究者警惕情感标注的局限性,适合做情绪计算的审慎参考。
人类具有选择性记忆能力,会保留相关事件而遗忘不重要的信息。若智能系统能感知用户事件的记忆度,将有助于更精准的用户建模,尤其在会议支持、记忆增强和会议摘要等场景中。传统观点认为情绪体验与记忆度密切相关:情绪强烈的时刻通常也更易被记住。因此,情感标注可能作为记忆度的代理指标。然而,现有情绪识别系统依赖第三方标注,难以准确反映第一人称的情感相关性与记忆度。本研究在动态非结构化群体互动中,对情绪(愉悦-唤醒)与记忆度进行连续时间标注,模拟在线会议支持等真实对话人工智能应用环境。结果表明,情绪与记忆度之间的关联性无法明显区别于随机预期。该发现对情感计算技术的发展与应用提出挑战,并在更广泛的领域讨论了未来研究方向。
原文摘要 · Abstract (English)
Humans have a selective memory, remembering relevant episodes and forgetting the less relevant information. Possessing awareness of event memorability for a user could help intelligent systems in more accurate user modelling, especially for such applications as meeting support systems, memory augmentation, and meeting summarisation. Emotion recognition has been widely studied, since emotions are thought to signal moments of high personal relevance to users. The emotional experience of situations and their memorability have traditionally been considered to be closely tied to one another: moments that are experienced as highly emotional are considered to also be highly memorable. This relationship suggests that emotional annotations could serve as proxies for memorability. However, existing emotion recognition systems rely heavily on third-party annotations, which may not accurately represent the first-person experience of emotional relevance and memorability. This is why, in this study, we empirically examine the relationship between perceived group emotions (Pleasure-Arousal) and group memorability in the context of conversational interactions. Our investigation involves continuous time-based annotations of both emotions and memorability in dynamic, unstructured group settings, approximating conditions of real-world conversational AI applications such as online meeting support systems. Our results show that the observed relationship between affect and memorability annotations cannot be reliably distinguished from what might be expected under random chance. We discuss the implications of this surprising finding for the development and applications of Affective Computing technology. In addition, we contextualise our findings in broader discourses in the Affective Computing and point out important targets for future research efforts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。