arXiv:2410.05401cs.CLcs.AI2024-10EMNLP被引 11

用大模型分析社交媒体气候广告的精准投放策略与公平性。

Post-hoc Study of Climate Microtargeting on Social Media Ads with LLMs: Thematic Insights and Fairness Evaluation

  • 用大模型分析广告针对的年龄性别,自动生成解释理由。
  • 青年群体多用环保行动主题,女性多用照顾者和社会倡导主题。
  • 发现对男性受众分类存在偏差,需改进投放公平性。

社交媒体上的气候变化传播日益采用微目标投放策略,以更有效地触达特定人群。本研究通过大型语言模型(LLMs)对Meta(原Facebook)广告进行事后分析,聚焦于人口统计学目标定位与公平性评估。我们检验了LLMs预测性别和年龄组目标的准确性,并要求其生成分类依据的透明解释,揭示不同群体所采用的具体主题策略。结果表明,年轻成年人主要通过强调激进主义和环境意识的消息吸引;而女性则更多通过与照料角色及社会倡导相关的主题吸引。此外,我们采用代表性公平性指标(如人口均等、机会均等、预测均等)评估模型在不同群体间的准确率和误差率差异。结果显示,尽管整体表现良好,但对男性群体的分类仍存在偏差。主题解释揭示了针对不同群体的重复性传播模式,而公平性分析凸显了提升投放包容性的必要性。本研究为未来增强社交媒体气候传播中的透明度、问责制与包容性提供了有效框架。

原文摘要 · Abstract (English)

Climate change communication on social media increasingly employs microtargeting strategies to effectively reach and influence specific demographic groups. This study presents a post-hoc analysis of microtargeting practices within climate campaigns by leveraging large language models (LLMs) to examine Meta (previously known as Facebook) advertisements. Our analysis focuses on two key aspects: demographic targeting and fairness. We evaluate the ability of LLMs to accurately predict the intended demographic targets, such as gender and age group. Furthermore, we instruct the LLMs to generate explanations for their classifications, providing transparent reasoning behind each decision. These explanations reveal the specific thematic elements used to engage different demographic segments, highlighting distinct strategies tailored to various audiences. Our findings show that young adults are primarily targeted through messages emphasizing activism and environmental consciousness, while women are engaged through themes related to caregiving roles and social advocacy. Additionally, we conduct a comprehensive fairness analysis to uncover biases in model predictions. We assess disparities in accuracy and error rates across demographic groups using established fairness metrics such as Demographic Parity, Equal Opportunity, and Predictive Equality. Our findings indicate that while LLMs perform well overall, certain biases exist, particularly in the classification of male audiences. The analysis of thematic explanations uncovers recurring patterns in messaging strategies tailored to various demographic groups, while the fairness analysis underscores the need for more inclusive targeting methods. This study provides a valuable framework for future research aimed at enhancing transparency, accountability, and inclusivity in social media-driven climate campaigns.

气候传播微目标大模型公平性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。