研究文字交流中如何用符号表达情绪,提升机器理解人类情感的能力。
Reading Between the Lines: How Electronic Nonverbal Cues shape Emotion Decoding
- 构建电子非语言线索分类体系,开发可自动识别的工具包。
- 实验证明这些符号能显著提高情绪识别准确率,减少歧义感。
- 揭示用户在模糊情境下倾向于负面解读的心理机制,适合人机交互设计参考。
随着基于文本的计算机中介沟通(CMC)日益成为日常互动的主要形式,一个核心问题重新浮现:当身体线索缺失时,用户如何重建非语言表达?本文系统性地探讨了电子非语言线索(eNVCs)——即肢体语言、语音和副语言的文字替代形式——在公开微博交流中的作用。通过三项互补研究,本文在概念、实证与方法上均有贡献。研究1基于非语言沟通理论构建统一的eNVC分类体系,并推出可扩展的Python工具包实现自动化检测。研究2采用被试内调查实验,提供因果证据表明,eNVCs显著提升情绪解码准确率并降低感知歧义,但讽刺等情境下其效果减弱或消失。研究3通过焦点小组讨论,揭示用户在推理数字语调时的解读策略,包括从缺失预期线索中推断意义,以及在模糊情境下默认倾向负面解释。三者共同确立了eNVCs为可衡量的数字行为类别,深化了线索丰富度与解读努力的理论模型,并为情感计算、用户建模及情绪感知界面设计提供实用工具。eNVC检测工具包已开源,支持Python与R,见https://github.com/kokiljaidka/envc。
原文摘要 · Abstract (English)
As text-based computer-mediated communication (CMC) increasingly structures everyday interaction, a central question re-emerges with new urgency: How do users reconstruct nonverbal expression in environments where embodied cues are absent? This paper provides a systematic, theory-driven account of electronic nonverbal cues (eNVCs) - textual analogues of kinesics, vocalics, and paralinguistics - in public microblog communication. Across three complementary studies, we advance conceptual, empirical, and methodological contributions. Study 1 develops a unified taxonomy of eNVCs grounded in foundational nonverbal communication theory and introduces a scalable Python toolkit for their automated detection. Study 2, a within-subject survey experiment, offers controlled causal evidence that eNVCs substantially improve emotional decoding accuracy and lower perceived ambiguity, while also identifying boundary conditions, such as sarcasm, under which these benefits weaken or disappear. Study 3, through focus group discussions, reveals the interpretive strategies users employ when reasoning about digital prosody, including drawing meaning from the absence of expected cues and defaulting toward negative interpretations in ambiguous contexts. Together, these studies establish eNVCs as a coherent and measurable class of digital behaviors, refine theoretical accounts of cue richness and interpretive effort, and provide practical tools for affective computing, user modeling, and emotion-aware interface design. The eNVC detection toolkit is available as a Python and R package at https://github.com/kokiljaidka/envc.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。