对比12个文本编码器在心理情绪理论中的情感表征能力
A Comparative Study on Affective Cues in Text Embeddings Across Psychological Emotion Theories

- 用三种情绪框架测试文本嵌入的情感信息捕获能力
- 指令感知开源模型在词级情感表征上优于闭源模型
- 任务微调模型在句级情感分类表现最佳,适合下游任务
文本编码器在自然语言处理中能高效压缩输入并保留语义,已广泛用于情感分析与情绪识别。然而,现代文本编码器的潜在表示是否符合明确的心理学情绪理论仍不清晰。本文通过探测12个最新发布的文本编码器,在三个成熟的情绪框架下,使用词级和句级数据进行回归与分类任务,评估其情感建模能力。同时采用语义数据泄露防护技术提升词级评估的鲁棒性。结果表明,最新的指令感知开源编码器在词级情感表征上包含的效价信息与闭源模型相当甚至更多;而任务微调及闭源编码器在句级情感分类任务中表现最优。此外,还提供了对潜在表示及其编码情感线索的定性分析。
原文摘要 · Abstract (English)
Text encoders are known for their utility in natural language processing, as they are able to efficiently compress inputs into dense vectors while preserving semantics. These models have been applied to affective computing, in particular to help with solving sentiment analysis and emotion recognition tasks. Nevertheless, it remains unclear to what extent the latent representations produced by modern text encoders capture well-defined psychological theories of affect. In this work, we investigate the affective capabilities of twelve recently released text encoders by probing their generated embeddings as input features for solving regression and classification tasks across three established emotion frameworks, using both word- and sentence-level data. Additionally, we apply a semantic data-leakage prevention technique to improve robustness in word-level evaluations. Our main findings show that the latent manifolds of the latest instruction-aware open-weight encoders enclose an equal or even a larger amount of affective information in comparison with proprietary counterparts when evaluated at word level. In contrast, embeddings of task-tuned and proprietary encoders reach the highest scores on sentence-level affective classification. Furthermore, a qualitative analysis of latent representations and their encoded affective cues is provided.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。