用讽刺检测提升立场识别,跨目标任务也能准
Sarcasm Detection as a Catalyst: Improving Stance Detection with Cross-Target Capabilities
- 以讽刺检测为中间任务,融合BERT/RoBERTa与深层网络
- 在域内任务中准确识别85%原被误判的讽刺文本
- 零样本迁移下跨目标识别性能接近本域水平
立场识别(SD)因广泛应用成为自然语言处理重要方向,但在线文本中常见的讽刺表达给算法带来挑战。本文提出利用讽刺检测作为中间任务来提升立场识别性能,并解决新目标缺乏标注数据的问题,实现跨目标立场识别(CTSD)。方法基于微调BERT和RoBERTa模型,再连接额外深度学习层。在公开数据集上对比多种前沿基线,结果表明该方法在域内与跨目标任务中均表现更优,即使未加入讽刺检测预训练也已超越最佳现有模型。引入讽刺知识后,能将原本被误判的讽刺文本准确率提升至85%,显著改善整体宏平均F1分数。在零样本微调条件下,跨目标任务性能接近本域水平。研究揭示迁移成功依赖于讽刺检测与立场识别间词汇属性的相关性。这是首次探索将讽刺检测作为立场识别中的迁移学习中介任务,结合预训练模型与深层结构,为后续研究提供基础基准。
原文摘要 · Abstract (English)
Stance Detection (SD) has become a critical area of interest due to its applications in various contexts leading to increased research within NLP. Yet the subtlety and complexity of texts sourced from online platforms often containing sarcastic language pose significant challenges for SD algorithms in accurately determining the authors stance. This paper addresses this by employing sarcasm for SD. It also tackles the issue of insufficient annotated data for training SD models on new targets by conducting Cross-Target SD (CTSD). The proposed approach involves fine-tuning BERT and RoBERTa models followed by concatenating additional deep learning layers. The approach is assessed against various State-Of-The-Art baselines for SD demonstrating superior performance using publicly available datasets. Notably our model outperforms the best SOTA models on both in-domain SD and CTSD tasks even before the incorporation of sarcasm-detection pre-training. The integration of sarcasm knowledge into the model significantly reduces misclassifications of sarcastic text elements in SD allowing our model to accurately predict 85% of texts that were previously misclassified without sarcasm-detection pre-training on in-domain SD. This enhancement contributes to an increase in the models average macro F1-score. The CTSD task achieves performance comparable to that of the in-domain task despite using a zero-shot finetuning. We also reveal that the success of the transfer-learning framework relies on the correlation between the lexical attributes of sarcasm detection and SD. This study represents the first exploration of sarcasm detection as an intermediate transfer-learning task within the context of SD while also leveraging the concatenation of BERT or RoBERTa with other deep-learning techniques. The proposed approach establishes a foundational baseline for future research in this domain.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。