用图神经网络分析评论关系,提升网络辱骂检测精度与效率
When Large Language Models Do Not Work: Online Incivility Prediction through Graph Neural Networks
- 构建评论图结构,融合语言内容与互动关系进行联合建模
- 在维基百科数据上超越12种大模型,准确率更高且推理成本更低
- 适合研究在线社区治理、行为预测与低资源模型部署的学者
在线不文明行为已成为数字社区中普遍且持续存在的问题,对用户造成重大社会与心理负担。尽管各平台通过人工审核和自动化检测试图遏制此类行为,现有方法在准确率与效率方面仍表现有限。为此,我们提出一种图神经网络(GNN)框架,用于检测英文维基百科社区中的三类不文明行为(即攻击性、侮辱性和人身攻击)。模型将每条用户评论视为节点,通过评论间文本相似度定义边,使网络能够同时学习语言内容与评论间的结构关系。我们还引入动态调整注意力机制,在信息聚合过程中自适应平衡节点特征与拓扑结构特征。实证评估表明,所提架构在多个指标上优于12种先进大语言模型(LLMs),且推理开销显著降低。结果凸显了结构上下文在检测在线不文明行为中的关键作用,揭示了纯文本大模型在行为预测中的局限性。所有数据集与对比结果将公开于代码仓库,以支持后续研究与可复现性。
原文摘要 · Abstract (English)
Online incivility has emerged as a widespread and persistent problem in digital communities, imposing substantial social and psychological burdens on users. Although many platforms attempt to curb incivility through moderation and automated detection, the performance of existing approaches often remains limited in both accuracy and efficiency. To address this challenge, we propose a Graph Neural Network (GNN) framework for detecting three types of uncivil behavior (i.e., toxicity, aggression, and personal attacks) within the English Wikipedia community. Our model represents each user comment as a node, with textual similarity between comments defining the edges, allowing the network to jointly learn from both linguistic content and relational structures among comments. We also introduce a dynamically adjusted attention mechanism that adaptively balances nodal and topological features during information aggregation. Empirical evaluations demonstrate that our proposed architecture outperforms 12 state-of-the-art Large Language Models (LLMs) across multiple metrics while requiring significantly lower inference cost. These findings highlight the crucial role of structural context in detecting online incivility and address the limitations of text-only LLM paradigms in behavioral prediction. All datasets and comparative outputs will be publicly available in our repository to support further research and reproducibility.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。