arXiv:2504.16947cs.SIcs.AI2025-04被引 1

用社会计算增强大模型,精准预测社交媒体社区反应。

SCRAG: Social Computing-Based Retrieval Augmented Generation for Community Response Forecasting in Social Media Environments

  • 结合历史回复与新闻等外部知识,动态建模社区语义和情绪。
  • 在X平台六类场景中平均提升10%以上评估指标表现。
  • 适合公关、危机管理及舆论分析等需要预判公众反应的场景。

本文提出SCRAG,一种受社会计算启发的预测框架,用于预测社区对真实或假设性社交媒体内容的响应。该框架可帮助公关人员规避信息误读,或供公众人物与意见领袖预判舆论反应,适用于舆情预测、危机管理及社会情景推演。尽管大语言模型(LLMs)在生成连贯且上下文丰富的文本方面表现卓越,但其依赖静态训练数据且易产生幻觉,在动态社交媒体环境中预测响应效果受限。SCRAG通过将LLMs与基于社会计算的检索增强生成(RAG)技术融合,有效克服上述问题:首先,从目标社区的历史回复中提取其意识形态、语义与情感特征;其次,引入新闻等外部知识以注入时间敏感背景。两者联合用于预测目标社区对新内容的回应。在X平台(前推特)的六个场景中,采用多种嵌入模型与LLM进行的实验表明,关键评估指标平均提升超10%。具体案例进一步验证其捕捉多元意识形态与细微差异的能力。本工作为需要准确洞察社区反应的应用提供了社会计算工具。

原文摘要 · Abstract (English)

This paper introduces SCRAG, a prediction framework inspired by social computing, designed to forecast community responses to real or hypothetical social media posts. SCRAG can be used by public relations specialists (e.g., to craft messaging in ways that avoid unintended misinterpretations) or public figures and influencers (e.g., to anticipate social responses), among other applications related to public sentiment prediction, crisis management, and social what-if analysis. While large language models (LLMs) have achieved remarkable success in generating coherent and contextually rich text, their reliance on static training data and susceptibility to hallucinations limit their effectiveness at response forecasting in dynamic social media environments. SCRAG overcomes these challenges by integrating LLMs with a Retrieval-Augmented Generation (RAG) technique rooted in social computing. Specifically, our framework retrieves (i) historical responses from the target community to capture their ideological, semantic, and emotional makeup, and (ii) external knowledge from sources such as news articles to inject time-sensitive context. This information is then jointly used to forecast the responses of the target community to new posts or narratives. Extensive experiments across six scenarios on the X platform (formerly Twitter), tested with various embedding models and LLMs, demonstrate over 10% improvements on average in key evaluation metrics. A concrete example further shows its effectiveness in capturing diverse ideologies and nuances. Our work provides a social computing tool for applications where accurate and concrete insights into community responses are crucial.

社交预测大模型舆情分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。