arXiv:2509.21747cs.CV2025-09被引 1

融合场景上下文与情绪标签,提升群体情绪识别准确率

Incorporating Scene Context and Semantic Labels for Enhanced Group-level Emotion Recognition

  • 用多尺度场景信息编码个体关系
  • 通过情绪标签生成细粒度语义词典
  • 适合做群体情感分析的研究者参考

群体情绪识别(GER)旨在识别包含多个人的场景中的整体情绪。现有方法低估了视觉场景上下文在建模个体关系中的作用,且忽视了情绪标签提供的语义信息对完整理解情绪的重要性。为此,我们提出一种新框架,融合视觉场景上下文与标签引导的语义信息以提升GER性能。该框架包含视觉上下文编码模块,利用多尺度场景信息多样化编码个体关系;同时,情绪语义编码模块借助群体级情绪标签,引导大语言模型生成细腻的情绪词典。这些词典结合情绪标签,经结构化情绪树进一步提炼为全面的语义表征。最后,通过相似性感知交互模块对齐并融合视觉与语义信息,生成增强的群体情绪表征,显著提升GER性能。在三个广泛使用的GER数据集上的实验表明,所提方法在性能上达到或超过当前最优水平。

原文摘要 · Abstract (English)

Group-level emotion recognition (GER) aims to identify holistic emotions within a scene involving multiple individuals. Current existed methods underestimate the importance of visual scene contextual information in modeling individual relationships. Furthermore, they overlook the crucial role of semantic information from emotional labels for complete understanding of emotions. To address this limitation, we propose a novel framework that incorporates visual scene context and label-guided semantic information to improve GER performance. It involves the visual context encoding module that leverages multi-scale scene information to diversely encode individual relationships. Complementarily, the emotion semantic encoding module utilizes group-level emotion labels to prompt a large language model to generate nuanced emotion lexicons. These lexicons, in conjunction with the emotion labels, are then subsequently refined into comprehensive semantic representations through the utilization of a structured emotion tree. Finally, similarity-aware interaction is proposed to align and integrate visual and semantic information, thereby generating enhanced group-level emotion representations and subsequently improving the performance of GER. Experiments on three widely adopted GER datasets demonstrate that our proposed method achieves competitive performance compared to state-of-the-art methods.

情绪识别群体分析视觉语言模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。