构建跨文化音乐情绪识别基准,揭示情绪术语的文化差异。
GlobalMood: A cross-cultural benchmark for music emotion recognition
- 采用参与者驱动方法收集59国音乐情绪词,避免预设分类。
- 覆盖2519人、98万+评分,验证跨文化情绪结构共性与差异。
- 提升非英语语境下模型性能,适用于多模态与跨语言研究。
人类对音乐情绪的标注对音乐生成和推荐系统至关重要。然而现有数据集主要聚焦西方歌曲,使用英文情绪术语,可能限制在不同语言和文化背景下的泛化能力。我们提出'GlobalMood',一个包含来自59个国家1,180首歌曲的跨文化基准数据集,通过在美、法、墨、韩、埃五地招募2,519名参与者进行大规模标注。不预设情绪类别,而是采用自下而上的参与式方法,自然衍生出具有文化特异性的音乐情绪词汇。随后另一批参与者对这些文化特定描述词进行了988,925次评分。分析表明,跨文化存在共同的效价-唤醒度结构,但相同词义的情绪感知仍存在显著差异。最先进的多模态模型在该跨文化平衡数据集上微调后,在非英语语境下性能显著提升。研究结果支持情绪描述的普遍性与文化特异性之争,并为其他多模态与跨语言研究提供可复用的方法论。
原文摘要 · Abstract (English)
Human annotations of mood in music are essential for music generation and recommender systems. However, existing datasets predominantly focus on Western songs with terms derived from English, which may limit generalizability across diverse linguistic and cultural backgrounds. We introduce 'GlobalMood', a novel cross-cultural benchmark dataset comprising 1,180 songs sampled from 59 countries, with large-scale annotations collected from 2,519 individuals across five culturally and linguistically distinct locations: U.S., France, Mexico, S. Korea, and Egypt. Rather than imposing predefined emotion and mood categories, we implement a bottom-up, participant-driven approach to organically elicit culturally specific music-related emotion terms. We then recruit another pool of human participants to collect 988,925 ratings for these culture-specific descriptors. Our analysis confirms the presence of a valence-arousal structure shared across cultures, yet also reveals significant divergences in how certain emotion terms (despite being dictionary equivalents) are perceived cross-culturally. State-of-the-art multimodal models benefit substantially from fine-tuning on our cross-culturally balanced dataset, particularly in non-English contexts. Broadly, our findings inform the ongoing debate on the universality versus cultural specificity of emotional descriptors, and our methodology can contribute to other multimodal and cross-lingual research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。