用定义和语义扩展增强数据,提升性别歧视检测精度。
Explaining Matters: Leveraging Definitions and Semantic Expansion for Sexism Detection
- 基于类别定义生成语义一致的合成数据,缓解数据稀疏问题。
- 在EDOS数据集上,细粒度分类宏F1提升4.1点,效果领先。
- 适合关注偏见检测与模型可解释性的研究者使用。
在线内容中的性别歧视检测仍是开放难题,因有害语言对女性及边缘群体影响更大。尽管已有自动化检测系统,但仍面临数据稀疏与语言细微性两大挑战。即使在大型优质数据集EDOS中,严重类别不平衡仍阻碍模型泛化。此外,细粒度类别边界模糊重叠,导致标注者意见分歧,反映性别歧视表达的复杂性。为此,我们提出两种基于提示的数据增强方法:基于定义的数据增强(DDA),利用类别特异性定义生成语义对齐的合成样本;上下文语义扩展(CSE),通过引入任务特定语义特征来弥补模型系统性错误。为进一步提升细粒度分类可靠性,引入集成策略,通过融合多个语言模型的互补视角解决预测冲突。在EDOS数据集上的实验表明,本方法在所有任务中均达到当前最优性能,二分类任务(任务A)宏F1提升1.5点,细粒度分类任务(任务C)提升4.1点。
原文摘要 · Abstract (English)
The detection of sexism in online content remains an open problem, as harmful language disproportionately affects women and marginalized groups. While automated systems for sexism detection have been developed, they still face two key challenges: data sparsity and the nuanced nature of sexist language. Even in large, well-curated datasets like the Explainable Detection of Online Sexism (EDOS), severe class imbalance hinders model generalization. Additionally, the overlapping and ambiguous boundaries of fine-grained categories introduce substantial annotator disagreement, reflecting the difficulty of interpreting nuanced expressions of sexism. To address these challenges, we propose two prompt-based data augmentation techniques: Definition-based Data Augmentation (DDA), which leverages category-specific definitions to generate semantically-aligned synthetic examples, and Contextual Semantic Expansion (CSE), which targets systematic model errors by enriching examples with task-specific semantic features. To further improve reliability in fine-grained classification, we introduce an ensemble strategy that resolves prediction ties by aggregating complementary perspectives from multiple language models. Our experimental evaluation on the EDOS dataset demonstrates state-of-the-art performance across all tasks, with notable improvements of macro F1 by 1.5 points for binary classification (Task A) and 4.1 points for fine-grained classification (Task C).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。