用上下文检测毒品暗语,比单纯查词表更准更抗规避。
Covering Cracks in Content Moderation: Delexicalized Distant Supervision for Illicit Drug Jargon Detection
- 通过上下文分析而非词表匹配来识别毒品隐语。
- 在两个数据集上F1分数和覆盖率达领先水平。
- 无需人工标注,能应对新词和伪装用法,适合平台风控。
随着毒品相关问题加剧及社交媒体的普及,非法药物的销售与讨论日益频繁。社交平台需进行内容审核,但因药物讨论中充斥大量隐晦用语而难度极大。以往方法仅依赖关键词列表,存在两大缺陷:易被同义替换绕过;无法区分如“pot”或“crack”等词是作为毒品还是正常含义使用。本文主张应基于上下文进行内容审核,而非依赖黑名单。然而,人工标注数据成本高且易过时。为此提出JEDIS框架,结合远程监督与去词法(delexicalization),可在无标注数据下训练,对新词和隐喻表达具有鲁棒性。在两个人工标注数据集上的实验表明,JEDIS在F1得分和检测覆盖率上显著优于现有基于词汇的方法。定性分析也验证其对现有方法常见陷阱的抵抗力。
原文摘要 · Abstract (English)
In light of rising drug-related concerns and the increasing role of social media, sales and discussions of illicit drugs have become commonplace online. Social media platforms hosting user-generated content must therefore perform content moderation, which is a difficult task due to the vast amount of jargon used in drug discussions. Previous works on drug jargon detection were limited to extracting a list of terms, but these approaches have fundamental problems in practical application. First, they are trivially evaded using word substitutions. Second, they cannot distinguish whether euphemistic terms such as "pot" or "crack" are being used as drugs or in their benign meanings. We argue that drug content moderation should be done using contexts rather than relying on a banlist. However, manually annotated datasets for training such a task are not only expensive but also prone to becoming obsolete. We present JEDIS, a framework for detecting illicit drug jargon terms by analyzing their contexts. JEDIS utilizes a novel approach that combines distant supervision and delexicalization, which allows JEDIS to be trained without human-labeled data while being robust to new terms and euphemisms. Experiments on two manually annotated datasets show JEDIS significantly outperforms state-of-the-art word-based baselines in terms of F1-score and detection coverage in drug jargon detection. We also conduct qualitative analysis that demonstrates JEDIS is robust against pitfalls faced by existing approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。