分析近2000万条Twitch聊天,发现游戏类型影响毒害行为差异。
Toxicity in Twitch Chats: An LLM-Based Analysis Across Gaming Communities

- 用预训练大模型零样本分类,识别聊天中的毒害内容
- 2.4%消息为毒害,MOBA类最高达3.2%,体育类最低仅2%
- 不同游戏间毒性差异显著,反映社区规范与游戏机制影响
在线游戏社区中的毒害行为持续存在,跨类型、平台和玩家互动广泛出现。尽管已有研究关注游戏内毒害,但对流媒体平台上不同游戏社区的毒害差异了解有限。本研究分析了来自Twitch上4,452个直播流的约2000万条聊天消息,涵盖七种游戏类型。通过预训练大语言模型进行零样本分类,依据Twitch的毒害分类体系(四类八子类),包括骚扰、歧视、性内容和粗俗用语。该方法在TextDetox数据集上取得94.5%的F1分数,且模型与人类判断一致性接近人与人之间的一致性。结果显示,所有消息中有2.4%被分类为毒害,不同类型间差异明显:MOBA类直播的相对毒害率最高(3.2%),体育类最低(2%)。此外,同一类型内不同游戏的毒害分布也存在显著差异,表明游戏特定的社区规范和机制在塑造毒害行为方面的作用超越类型层面。这些发现为理解Twitch上基于类型与具体游戏的毒害模式提供了实证支持,有助于制定更精准的社区管理策略。
原文摘要 · Abstract (English)
Toxicity in online gaming communities remains a persistent challenge, manifesting across genres, platforms, and player interactions. While much research is focused on in-game toxicity, less is known about how toxic behavior varies between gaming communities on streaming platforms. To address this shortcoming, we analyze approximately 20 million chat messages from 4,452 streams, spanning seven game genres on Twitch. We categorize messages according to Twitch's toxicity taxonomy with a pre-trained Large Language Model using zero-shot classification. The taxonomy comprises four categories and eight subclasses, including harassment, discrimination, sexual content, and profanity. Our approach achieves an F1 score of 94.5% on the TextDetox dataset and demonstrates human-model agreement comparable to inter-human agreement. Our analysis reveals that 2.4% of all messages are classified as toxic, with notable differences across genres: streams of MOBA games exhibit the highest relative rate of toxicity (3.2%), and sports games show the lowest rate (2%). Furthermore, results indicate that individual games differ significantly in their toxicity distributions, even within genres, suggesting the existence of game-specific community norms and mechanics that shape toxic behavior beyond genre-level effects. These findings offer empirical insights into genre- and game-specific toxicity patterns on Twitch and can inform more targeted moderation strategies for gaming communities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。