arXiv:2607.16790cs.CLcs.SY2026-07

对比分层检测的级联与联合建模,发现级联更准但更耗资源。

Cascading versus Joint Modeling for Hierarchical Offensive Language Detection

  • 为每个子任务定制训练策略,优化类别不平衡处理
  • 级联系统在三个子任务上分别取得0.795、0.716、0.557的宏F1
  • 适合追求高精度且能承受更高参数和延迟的部署场景

细粒度仇恨语言检测采用层级标签结构,现有方法主要分为级联分解与联合多任务建模两种范式。以往研究很少在准确率、参数量和推理延迟维度上进行直接、受控比较,也未验证所选类别不平衡处理策略是否最优。本文提出一个三级级联检测系统,为各子任务定制训练策略,并引入两种验证机制:首先通过受控消融实验确定各子任务的最佳不平衡处理方式;其次训练共享编码器的联合多任务模型作为架构对照,获得真实性能数据。实验表明,级联系统在官方测试集三个子任务上分别达到0.795、0.716、0.557的宏F1。消融研究显示,仅凭不平衡严重程度直觉配置损失函数效果不佳,基于消融结果重调后性能与稳定性均提升。端到端级联评估发现,约五分之一错误源于第一阶段过滤器,后续阶段无法修正。相较联合模型,级联架构在所有子任务上表现更优,尤其在最严重不平衡子任务上提升7.1点宏F1,但参数量增加3倍,推理延迟提高1.67倍。结果明确揭示了级联架构的精度优势与部署成本之间的量化权衡。

原文摘要 · Abstract (English)

Fine-grained offensive language detection organizes labels into a hierarchical structure, for which two modeling paradigms exist: cascaded decomposition and joint multi-task modeling. Prior work rarely provides a direct, controlled comparison of the two paradigms in terms of accuracy, parameter count, and inference latency, and rarely verifies whether a chosen class-imbalance handling strategy is actually optimal. This paper proposes a three-level cascaded detection system whose training strategy is customized per subtask, together with two verification mechanisms. First, a controlled ablation study determines the best class-imbalance handling strategy for each subtask. Second, a joint multi-task model with a shared encoder is trained as an architectural control, yielding real measurements along the dimensions of accuracy, parameter count, and inference latency. Experiments show that the cascaded system attains macro-F1 scores of 0.795, 0.716, and 0.557 on the three subtasks of the official test set. The ablation study reveals that configuring the loss function purely by imbalance-severity intuition is suboptimal; reconfiguring based on the ablation results improves both performance and stability. End-to-end cascade evaluation shows that roughly one-fifth of the errors in the cascade pipeline originate from the first-stage filter and cannot be corrected by subsequent stages. Relative to the joint multi-task model, the cascaded architecture achieves higher accuracy on all three subtasks, with a 7.1-point macro-F1 gain on the most severely imbalanced subtask, at the cost of three times the parameters and 1.67 times the inference latency. Together, these results establish an explicit, quantifiable trade-off between the accuracy advantage of cascaded architectures and their deployment cost.

仇恨语言检测级联模型多任务学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。