首个西语社交媒体支持文本检测数据集,提升在线互助识别准确率。
Online Social Support Detection in Spanish Social Media Texts
- 构建3189条标注的西语评论数据集,用GPT-4o生成平衡样本
- 平衡数据使个体与群体支持检测效果提升,GPT-4o在整体分类最优
- 为构建正向网络环境提供技术基础,适合社会计算研究者参考
社交媒体重塑了人类交流方式,使人们能够分享经历、寻求支持并参与多元讨论。尽管有害内容(如仇恨言论)的研究已较为深入,但正面支持性互动的识别与促进仍鲜有探索。本研究提出一种新型方法,用于检测西语社交媒体文本中的在线社会支持。我们首次构建了专为此任务设计的标注数据集,包含3,189条YouTube评论,分为支持性与非支持性两类。为缓解数据不平衡问题,采用GPT-4o生成改写评论以构建平衡数据集。在未平衡数据上评估了传统机器学习、深度学习及Transformer模型(含GPT-4o)的性能。随后使用Transformer模型对比平衡与未平衡数据集的表现。结果表明,平衡数据集在任务2(个体与群体支持)和任务3(国家、其他、LGBTQ、黑人群体、女性、宗教)中表现更优;而GPT-4o在任务1(支持与非支持)中表现最佳。研究强调了营造积极线上环境的重要性,并为自动化社会支持检测提供了基础框架。
原文摘要 · Abstract (English)
The advent of social media has transformed communication, enabling individuals to share their experiences, seek support, and participate in diverse discussions. While extensive research has focused on identifying harmful content like hate speech, the recognition and promotion of positive and supportive interactions remain largely unexplored. This study proposes an innovative approach to detecting online social support in Spanish-language social media texts. We introduce the first annotated dataset specifically created for this task, comprising 3,189 YouTube comments classified as supportive or non-supportive. To address data imbalance, we employed GPT-4o to generate paraphrased comments and create a balanced dataset. We then evaluated social support classification using traditional machine learning models, deep learning architectures, and transformer-based models, including GPT-4o, but only on the unbalanced dataset. Subsequently, we utilized a transformer model to compare the performance between the balanced and unbalanced datasets. Our findings indicate that the balanced dataset yielded improved results for Task 2 (Individual and Group) and Task 3 (Nation, Other, LGBTQ, Black Community, Women, Religion), whereas GPT-4o performed best for Task 1 (Social Support and Non-Support). This study highlights the significance of fostering a supportive online environment and lays the groundwork for future research in automated social support detection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。