arXiv:2602.04693cs.CLcs.CY2026-02

用语言图优化框架提升大模型对网络不文明言论意图的准确识别

LinGO: A Linguistic Graph Optimization Framework with LLMs for Interpreting Intents of Online Uncivil Discourse

  • 将语言分解为多步结构,针对错误集中环节迭代优化提示与示例
  • 在巴西总统选举数据集上,各项指标均优于零样本、思维链等基线方法
  • 适合需要精准理解复杂语义意图的平台内容审核与社会治理场景

识别不文明语言对维护安全、包容和民主的在线空间至关重要。然而现有分类器常误判包含不文明线索但表达文明意图的帖子,导致线上有害不文明行为被高估。本文提出 LinGO,一种面向大语言模型(LLMs)的语言图优化框架,通过利用语言结构与优化技术,对采用多种直接与间接表达方式的政治不文明行为进行多类别意图分类。LinGO 将语言分解为多步骤语言成分,识别导致错误最严重的步骤,并迭代优化提示和/或示例组件。我们在2022年巴西总统选举期间收集的数据集上评估该方法,涵盖四种政治不文明形式:无礼(IMP)、仇恨言论与刻板印象(HSST)、人身伤害与暴力政治修辞(PHAVPR)、对民主制度与价值的威胁(THREAT)。每个实例标注了六类文明/不文明意图。使用三种低成本大模型(GPT-5-mini、Gemini 2.5 Flash-Lite、Claude 3 Haiku)和四种优化技术(TextGrad、AdalFlow、DSPy、RAG)进行基准测试。结果表明,所有模型下,LinGO均持续提升准确率与加权F1,优于零样本、思维链、直接优化与微调基线。RAG表现最强,与Gemini模型结合时达到最佳整体性能。研究证明,在大模型指令中融入多步语言成分并优化关键组件,有助于模型解释复杂语义,未来可拓展至其他复杂语义解析任务。

原文摘要 · Abstract (English)

Detecting uncivil language is crucial for maintaining safe, inclusive, and democratic online spaces. Yet existing classifiers often misinterpret posts containing uncivil cues but expressing civil intents, leading to inflated estimates of harmful incivility online. We introduce LinGO, a linguistic graph optimization framework for large language models (LLMs) that leverages linguistic structures and optimization techniques to classify multi-class intents of incivility that use various direct and indirect expressions. LinGO decomposes language into multi-step linguistic components, identifies targeted steps that cause the most errors, and iteratively optimizes prompt and/or example components for targeted steps. We evaluate it using a dataset collected during the 2022 Brazilian presidential election, encompassing four forms of political incivility: Impoliteness (IMP), Hate Speech and Stereotyping (HSST), Physical Harm and Violent Political Rhetoric (PHAVPR), and Threats to Democratic Institutions and Values (THREAT). Each instance is annotated with six types of civil/uncivil intent. We benchmark LinGO using three cost-efficient LLMs: GPT-5-mini, Gemini 2.5 Flash-Lite, and Claude 3 Haiku, and four optimization techniques: TextGrad, AdalFlow, DSPy, and Retrieval-Augmented Generation (RAG). The results show that, across all models, LinGO consistently improves accuracy and weighted F1 compared with zero-shot, chain-of-thought, direct optimization, and fine-tuning baselines. RAG is the strongest optimization technique and, when paired with Gemini model, achieves the best overall performance. These findings demonstrate that incorporating multi-step linguistic components into LLM instructions and optimize targeted components can help the models explain complex semantic meanings, which can be extended to other complex semantic explanation tasks in the future.

意图识别大模型优化不文明内容语言图

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。