用上下文感知损失提升敏感内容检测准确率
SugarTextNet: A Transformer-Based Framework for Detecting Sugar Dating-Related Content on Social Media with Context-Aware Focal Loss
- 基于Transformer架构,融合注意力与上下文编码捕捉微妙语义
- 在3067条微博数据上,显著优于传统模型与大模型
- 适合社交平台内容审核团队用于识别隐晦的交易型关系言论
糖约会相关内容在主流社交媒体上迅速蔓延,引发严重的社会与监管问题,包括亲密关系商业化及交易性关系正常化。由于普遍存在微妙隐喻、模糊语言线索以及真实数据中极端的类别不平衡,此类内容的检测极具挑战性。本文提出SugarTextNet,一种专为识别社交媒体中糖约会相关帖子设计的新型Transformer框架。该框架集成预训练Transformer编码器、基于注意力的线索提取器和上下文短语编码器,以捕捉用户生成文本中的显著与细微特征。为解决类别不平衡并增强少数类检测,我们引入上下文感知焦点损失(Context-Aware Focal Loss),结合焦点损失缩放与上下文加权机制。我们在一个新构建的、人工标注的3,067条中文微博数据集上评估了SugarTextNet,结果表明,该方法在多个指标上显著优于传统机器学习模型、深度学习基线模型及大型语言模型。全面的消融实验验证了各组件的不可或缺性。研究强调了领域特定、上下文感知建模在敏感内容检测中的重要性,并为复杂真实场景下的内容审核提供了稳健解决方案。
原文摘要 · Abstract (English)
Sugar dating-related content has rapidly proliferated on mainstream social media platforms, giving rise to serious societal and regulatory concerns, including commercialization of intimate relationships and the normalization of transactional relationships.~Detecting such content is highly challenging due to the prevalence of subtle euphemisms, ambiguous linguistic cues, and extreme class imbalance in real-world data.~In this work, we present SugarTextNet, a novel transformer-based framework specifically designed to identify sugar dating-related posts on social media.~SugarTextNet integrates a pretrained transformer encoder, an attention-based cue extractor, and a contextual phrase encoder to capture both salient and nuanced features in user-generated text.~To address class imbalance and enhance minority-class detection, we introduce Context-Aware Focal Loss, a tailored loss function that combines focal loss scaling with contextual weighting.~We evaluate SugarTextNet on a newly curated, manually annotated dataset of 3,067 Chinese social media posts from Sina Weibo, demonstrating that our approach substantially outperforms traditional machine learning models, deep learning baselines, and large language models across multiple metrics.~Comprehensive ablation studies confirm the indispensable role of each component.~Our findings highlight the importance of domain-specific, context-aware modeling for sensitive content detection, and provide a robust solution for content moderation in complex, real-world scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。