构建首个区分语义与语气毒性的语音数据集,提升有毒语音检测效果
Beyond Content: A Comprehensive Speech Toxicity Dataset and Detection Framework Incorporating Paralinguistic Cues

- 设计双头神经网络,分别识别毒性来源和具体类型
- 在3万+音频上实现21.1%的宏平均F1提升
- 适合语音安全、内容审核等实际应用开发者
有毒语音检测是保障在线交流安全的关键挑战。现有方法多忽视情绪、语调、语速等副语言特征的作用,且数据集以文本为主,难以捕捉语音中的非语义毒性线索。为此,我们提出ToxiAlert-Bench,一个包含30,000+音频片段的大规模音频数据集,涵盖七类主要毒性类别与二十种细粒度标签,并标注毒性来源(文本或副语言)。此外,我们设计一种双头神经网络,采用多阶段训练策略:先独立训练各头部,再联合微调以减少任务干扰;通过类别平衡采样和加权损失缓解数据不平衡问题。实验表明,引入副语言特征显著提升性能,在多个指标上优于现有基线,宏平均F1相对提升21.1%,准确率提高13.0%,验证了方法的有效性与实用性。
原文摘要 · Abstract (English)
Toxic speech detection has become a crucial challenge in maintaining safe online communication environments. However, existing approaches to toxic speech detection often neglect the contribution of paralinguistic cues, such as emotion, intonation, and speech rate, which are key to detecting speech toxicity. Moreover, current toxic speech datasets are predominantly text-based, limiting the development of models that can capture paralinguistic cues.To address these challenges, we present ToxiAlert-Bench, a large-scale audio dataset comprising over 30,000 audio clips annotated with seven major toxic categories and twenty fine-grained toxic labels. Uniquely, our dataset annotates toxicity sources -- distinguishing between textual content and paralinguistic origins -- for comprehensive toxic speech analysis.Furthermore, we propose a dual-head neural network with a multi-stage training strategy tailored for toxic speech detection. This architecture features two task-specific classification headers: one for identifying the source of sensitivity (textual or paralinguistic), and the other for categorizing the specific toxic type. The training process involves independent head training followed by joint fine-tuning to reduce task interference. To mitigate data class imbalance, we incorporate class-balanced sampling and weighted loss functions.Our experimental results show that leveraging paralinguistic features significantly improves detection performance. Our method consistently outperforms existing baselines across multiple evaluation metrics, with a 21.1% relative improvement in Macro-F1 score and a 13.0% relative gain in accuracy over the strongest baseline, highlighting its enhanced effectiveness and practical applicability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。