用同音字图与毒语词典破解中文毒语伪装,无需训练和提示。
Breaking the Cloak! Unveiling Chinese Cloaked Toxicity with Homophone Graph and Toxic Lexicon
- 基于同音字图和毒语词典匹配候选词,再用BERT与LLM过滤并还原真实毒性
- 在两个中文数据集上F1提升71%,准确率提升35%,超越最强对手
- 适合中文内容审核、反作弊系统开发者使用
社交媒体上的毒害内容(如侮辱性语言和歧视性言论)呈上升趋势,给内容审核带来挑战。部分用户通过同音伪装规避审查,亟需识别此类伪装毒性。现有方法多针对英文文本,中文场景尚未解决。为此,我们提出C²TU,一种无需训练、无需提示的中文同音伪装毒性识别新方法。首先利用同音字图和毒语词典进行子串匹配,定位候选毒词;再通过BERT与大模型双版本过滤非毒词,并纠正伪装还原为真实毒性。针对大模型自回归限制,我们引入完整语境信息以更精准揭示伪装词。大量实验表明,该方法在两个中文毒语数据集上表现卓越,相较最优基线,F1最高提升71%,准确率提升35%。代码与数据已开源。
原文摘要 · Abstract (English)
Social media platforms have experienced a significant rise in toxic content, including abusive language and discriminatory remarks, presenting growing challenges for content moderation. Some users evade censorship by deliberately disguising toxic words through homophonic cloak, which necessitates the task of unveiling cloaked toxicity. Existing methods are mostly designed for English texts, while Chinese cloaked toxicity unveiling has not been solved yet. To tackle the issue, we propose C$^2$TU, a novel training-free and prompt-free method for Chinese cloaked toxic content unveiling. It first employs substring matching to identify candidate toxic words based on Chinese homo-graph and toxic lexicon. Then it filters those candidates that are non-toxic and corrects cloaks to be their corresponding toxicities. Specifically, we develop two model variants for filtering, which are based on BERT and LLMs, respectively. For LLMs, we address the auto-regressive limitation in computing word occurrence probability and utilize the full semantic contexts of a text sequence to reveal cloaked toxic words. Extensive experiments demonstrate that C$^2$TU can achieve superior performance on two Chinese toxic datasets. In particular, our method outperforms the best competitor by up to 71% on the F1 score and 35% on accuracy, respectively. Our code and data are available at https://github.com/XDxc-cuber/C2TU-Chinese-cloaked-toxicity-unveiling.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。