arXiv:2511.17301cs.CLcs.AI2025-11被引 1

用大模型分析南非语言社交媒体情绪,发现多模型融合可精准识别社会问题。

Large Language Models for Sentiment Analysis to Detect Social Challenges: A Use Case with South African Languages

  • 用GPT-3.5、GPT-4等5个大模型零样本分析英语、塞佩迪语、茨瓦纳语帖子情绪。
  • 多模型融合后分类错误低于1%,显著提升情绪识别准确率。
  • 适合关注多语言社会舆情监测的政府机构与研究者使用。

情感分析有助于理解公众对社会议题的观点与情绪。在多语言社区中,情感分析系统可快速识别社交媒体中的社会挑战,帮助政府部门更精准有效地应对。近年来,大型语言模型(LLMs)已广泛公开,初步研究表明其在英语上具备出色的零样本情感分析能力。然而,尚无研究探讨利用LLMs对南非语言的社交媒体内容进行情感分析并识别社会挑战。因此,本文分析了当前最先进的大模型GPT-3.5、GPT-4、LlaMa 2、PaLM 2和Dolly 2,在英语、塞佩迪语和茨瓦纳语社交媒体帖子中对10个新兴话题的情感极性表现,覆盖10个南非政府部门管辖区域。结果表明,不同模型、话题和语言间存在显著差异。此外,多模型结果融合可带来显著性能提升,情感分类错误低于1%。这表明,构建可靠的情绪分析系统以检测社会挑战并针对特定话题和语言群体提出行动建议已成为可能。

原文摘要 · Abstract (English)

Sentiment analysis can aid in understanding people's opinions and emotions on social issues. In multilingual communities sentiment analysis systems can be used to quickly identify social challenges in social media posts, enabling government departments to detect and address these issues more precisely and effectively. Recently, large-language models (LLMs) have become available to the wide public and initial analyses have shown that they exhibit magnificent zero-shot sentiment analysis abilities in English. However, there is no work that has investigated to leverage LLMs for sentiment analysis on social media posts in South African languages and detect social challenges. Consequently, in this work, we analyse the zero-shot performance of the state-of-the-art LLMs GPT-3.5, GPT-4, LlaMa 2, PaLM 2, and Dolly 2 to investigate the sentiment polarities of the 10 most emerging topics in English, Sepedi and Setswana social media posts that fall within the jurisdictional areas of 10 South African government departments. Our results demonstrate that there are big differences between the various LLMs, topics, and languages. In addition, we show that a fusion of the outcomes of different LLMs provides large gains in sentiment classification performance with sentiment classification errors below 1%. Consequently, it is now feasible to provide systems that generate reliable information about sentiment analysis to detect social challenges and draw conclusions about possible needs for actions on specific topics and within different language groups.

情感分析多语言大模型社会舆情

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。