arXiv:2502.15155cs.CLcs.AI2025-02中稿 · 7th International …被引 3

对比开源与闭源大模型在极端言论分类中的表现,发现微调后性能差距消失。

Extreme Speech Classification in the Era of LLMs: Exploring Open-Source and Proprietary Models

  • 用印度子集数据集微调大模型,提升对极端言论的识别能力。
  • 闭源GPT零样本表现更好,但微调后与开源Llama性能相当。
  • 适合关注内容安全与大模型应用的研究者与平台方参考。

近年来,互联网普及和社交媒体用户增长导致网络极端言论泛滥。传统语言模型虽能区分中性与非中性文本,但对极端言论的细粒度分类仍面临挑战,需深入理解社会文化语境,且人工标注一致性低,亟需自动化系统。大语言模型(LLMs)因训练语料广泛、上下文建模能力强,成为解决该任务的有力工具。本文基于Maronikolakis等(2022)提出的极端言论数据集的印度子集,构建了基于LLMs的分类框架,对比开源Llama与闭源OpenAI模型。结果表明:预训练模型在零样本下表现中等,但领域数据微调显著提升性能,体现其对语言与语境细微差别的适应能力。尽管GPT系列在零样本下优于Llama,但微调后两者性能差距消失。

原文摘要 · Abstract (English)

In recent years, widespread internet adoption and the growth in userbase of various social media platforms have led to an increase in the proliferation of extreme speech online. While traditional language models have demonstrated proficiency in distinguishing between neutral text and non-neutral text (i.e. extreme speech), categorizing the diverse types of extreme speech presents significant challenges. The task of extreme speech classification is particularly nuanced, as it requires a deep understanding of socio-cultural contexts to accurately interpret the intent of the language used by the speaker. Even human annotators often disagree on the appropriate classification of such content, emphasizing the complex and subjective nature of this task. The use of human moderators also presents a scaling issue, necessitating the need for automated systems for extreme speech classification. The recent launch of ChatGPT has drawn global attention to the potential applications of Large Language Models (LLMs) across a diverse variety of tasks. Trained on vast and diverse corpora, and demonstrating the ability to effectively capture and encode contextual information, LLMs emerge as highly promising tools for tackling this specific task of extreme speech classification. In this paper, we leverage the Indian subset of the extreme speech dataset from Maronikolakis et al. (2022) to develop an effective classification framework using LLMs. We evaluate open-source Llama models against closed-source OpenAI models, finding that while pre-trained LLMs show moderate efficacy, fine-tuning with domain-specific data significantly enhances performance, highlighting their adaptability to linguistic and contextual nuances. Although GPT-based models outperform Llama models in zero-shot settings, the performance gap disappears after fine-tuning.

极端言论大模型分类微调

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。