多语言社交网络中识别雷鸣词再定义用法,提升跨语言歧视语检测准确率。
KIT-TIP-NLP at MultiPride: Continual Learning with Multilingual Foundation Model

- 融合回译增强与动态采样,解决数据少、类别不平衡问题。
- 通过语言特异性阈值优化,提升F1分数2-5个百分点。
- 支持英语、西班牙语、意大利语,可复现性强,适合伦理安全研究者。
本文提出一种多阶段框架,用于检测多语言社交媒体中对LGBTQ+相关贬义词的再定义使用。针对英文、西班牙文和意大利文推文中的重申性与非重申性用法区分难题,解决数据稀缺、类别不平衡及跨语言情感表达差异三大挑战。方法包括基于交叉验证的数据驱动模型选择、通过回译实现语义保留的数据增强、基于动态分阶段欠采样的归纳迁移学习,以及通过掩码语言建模注入领域知识。系统评估了八种多语言嵌入模型,最终选定XLM-RoBERTa作为基础模型。利用GPT-4o-mini将数据回译至其他语言,训练集规模有效提升三倍,同时保持语义一致性和类别分布比例。共生成四个最终运行结果:RUN 1采用增强与欠采样;RUN 2引入掩码语言建模预训练;RUN 3与RUN 4则通过语言特异性决策阈值优化(基于ROC分析)改进先前预测。语言特异性阈值优化使F1分数绝对提升2%-5%,无需重新训练模型。整个方法完全可复现,代码与实验设置已公开于https://github.com/rbg-research/MultiPRIDE-Evalita-2026。
原文摘要 · Abstract (English)
This paper presents a multi-stage framework for detecting reclaimed slurs in multilingual social media discourse. It addresses the challenge of identifying reclamatory versus non-reclamatory usage of LGBTQ+-related slurs across English, Spanish, and Italian tweets. The framework handles three intertwined methodological challenges like data scarcity, class imbalance, and cross-linguistic variation in sentiment expression. It integrates data-driven model selection via cross-validation, semantic-preserving augmentation through back-translation, inductive transfer learning with dynamic epoch-level undersampling, and domain-specific knowledge injection via masked language modeling. Eight multilingual embedding models were evaluated systematically, with XLM-RoBERTa selected as the foundation model based on macro-averaged F1 score. Data augmentation via GPT-4o-mini back-translation to alternate languages effectively tripled the training corpus while preserving semantic content and class distribution ratios. The framework produces four final runs for the evaluation purposes where RUN 1 is inductive transfer learning with augmentation and undersampling, RUN 2 with masked language modeling pre-training, RUN 3 and RUN 4 are previous predictions refined via language-specific decision thresholds optimized via ROC analysis. Language-specific threshold refinement reveals that optimal decision boundaries vary significantly across languages. This reflects distributional differences in model confidence scores and linguistic variation in reclamatory language usage. The threshold-based optimization yields 2-5% absolute F1 improvement without requiring model retraining. The methodology is fully reproducible, with all code and experimental setup available at https://github.com/rbg-research/MultiPRIDE-Evalita-2026.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。