用大模型清洗文本并补充语义,低成本提升有害内容识别效果
LLM-based Semantic Augmentation for Harmful Content Detection
- 用大模型对文本去噪并生成上下文解释,增强训练数据
- 在多个数据集上达到与人工标注相当的检测性能
- 适合需要低成本高效构建分类模型的研究者
大型语言模型(LLMs)在简单文本分类任务中表现优异,尤其在零样本设置下。然而,在应对如宣传内容检测、仇恨梗图分类和毒性识别等复杂社交媒体挑战时,其效果显著下降。现有研究多聚焦于利用LLM生成合成训练数据,却忽视了基于LLM的文本预处理与语义增强潜力。本文提出一种新方法:通过提示LLM清理噪声文本并提供富含上下文的解释,从而在不显著增加数据量的前提下提升训练集质量。我们在SemEval 2024多标签说服性梗图数据集上进行系统评估,并在Google Jigsaw有毒评论与Facebook仇恨梗图数据集上验证泛化能力。结果表明,零样本LLM分类在高上下文任务中表现逊于监督模型;而结合基于LLM的语义增强后,性能可媲美依赖人工标注的方法,且成本极低。该研究强调了在社交媒体分类任务中战略性地整合LLM的重要性,对在线有害内容治理具有广泛意义。
原文摘要 · Abstract (English)
Recent advances in large language models (LLMs) have demonstrated strong performance on simple text classification tasks, frequently under zero-shot settings. However, their efficacy declines when tackling complex social media challenges such as propaganda detection, hateful meme classification, and toxicity identification. Much of the existing work has focused on using LLMs to generate synthetic training data, overlooking the potential of LLM-based text preprocessing and semantic augmentation. In this paper, we introduce an approach that prompts LLMs to clean noisy text and provide context-rich explanations, thereby enhancing training sets without substantial increases in data volume. We systematically evaluate on the SemEval 2024 multi-label Persuasive Meme dataset and further validate on the Google Jigsaw toxic comments and Facebook hateful memes datasets to assess generalizability. Our results reveal that zero-shot LLM classification underperforms on these high-context tasks compared to supervised models. In contrast, integrating LLM-based semantic augmentation yields performance on par with approaches that rely on human-annotated data, at a fraction of the cost. These findings underscore the importance of strategically incorporating LLMs into machine learning (ML) pipeline for social media classification tasks, offering broad implications for combating harmful content online.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。