arXiv:2604.10175cs.CRcs.CY2026-04中稿 · ESORICS'26

构建游戏实时对话毒害检测数据集,提升反骚扰系统实用性。

"bot lane noob" Towards Deployment of NLP-based Toxicity Detectors in Video Games

  • 联合8名顶级玩家构建细粒度标注数据集L2DTnH。
  • 自研检测器在1.4k毒害消息上表现优于主流工具。
  • 开源完整资源,支持浏览器插件离线运行。

游戏中的攻击性言论和欺凌行为普遍存在,尤其在竞技类多人在线对战中,玩家间发送的有害信息可能引发从不适到抑郁等严重后果。尽管已有大量研究揭示其负面影响,但极少工作针对比赛过程中实际发生的文本交流开发并验证过自动检测机制。本文指出,这主要源于缺乏高质量的NLP/ML可用数据集。为此,我们通过系统文献综述(n=1,039)确认该问题,并与8位《英雄联盟》(LoL)专家玩家合作,构建了包含1.4k毒害消息与13.8k非毒害消息的精细标注数据集L2DTnH。基于此,我们训练出一个检测器,在性能上超越通用及当前最先进的毒性检测模型。进一步地,我们在跨数据集场景下验证其泛化能力,并开发了一个无需调用外部AI服务器的浏览器扩展,可实时标记网页中的毒害内容。所有资源均已公开,为游戏领域反毒害研究提供坚实基础。

原文摘要 · Abstract (English)

Toxicity and harassment are widespread in the video-gaming context. Especially in competitive online multiplayer scenarios, gamers oftentimes send harmful messages to other players (teammates or opponents) whose consequences span from mild annoyance to withdrawal and depression. Abundant prior work tackled these problems, e.g., pointing out the negative effects of toxic interactions. However, few works proposed countermeasures specifically developed and tested on textual messages sent during a match -- i.e., when the "harassment" actually occurs. We posit that such a scarcity stems from the lack of high-quality datasets that can be used to devise "automated" detectors based on natural-language processing (NLP) and machine learning (ML), and which can -- ideally -- mitigate the harm of toxic comments during a gaming session. This work provides a foundation for addressing the problem of toxicity and harassment in video games. First, through a systematic literature review (n=1,039), we provide evidence that only few works proposed ML/NLP-based detectors of toxicity/harassment during live matches. Then, we partner-up with 8 expert League of Legend (LoL) players and create a fine-grained labelled dataset, L2DTnH, containing 1.4k toxic and 13.8k non-toxic messages exchanged during LoL matches. We use L2DTnH to develop a detector that we then empirically show outperforms general-purpose and state-of-the-art toxicity detectors reliant on NLP. To further demonstrate the practicality of our resources, we test our detector on game-related data beyond that included in L2DTnH; and we develop a Web-browser extension that flags toxic content in Webpages -- without querying third-party servers owned by AI companies. We publicly release all of our resources. Our contributions pave the way for more applied research devoted to fighting the spread of toxicity and harassment in video games.

游戏安全毒性检测NLP应用数据集

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。