用增强特征的Transformer模型,多语言检测新闻句子主观性。
QU-NLP at CheckThat! 2025: Multilingual Subjectivity in News Articles Detection using Feature-Augmented Transformer Models with Sequential Cross-Lingual Fine-Tuning
- 融合预训练模型与词法、统计特征,提升主观性识别能力。
- 英语和罗马尼亚语零样本设置下表现最佳,最高宏F1达0.8126。
- 跨语言微调顺序与语言相似性影响模型效果,需谨慎设计。
本文介绍我们在CheckThat! 2025任务1中关于主观性检测的方法,旨在区分新闻句子是作者的主观观点还是客观陈述。我们提出一种特征增强的Transformer架构,将预训练语言模型的上下文嵌入与统计及语言学特征结合。针对阿拉伯语,采用AraELECTRA并加入词性标注(POS)和TF-IDF特征;其他语言则使用跨语言DeBERTa~V3模型,通过门控机制融合TF-IDF特征进行微调。系统在单语、多语及零样本设置下评估,涵盖英语、阿拉伯语、德语、意大利语及多个未见语言。结果表明,该方法在多种语言上表现优异,英语(第1名,宏F1=0.8052)、德语(第3名,宏F1=0.8013)、阿拉伯语(第4名,宏F1=0.5771)和罗马尼亚语(零样本第1名,宏F1=0.8126)均取得显著成果。消融分析显示,TF-IDF与门控机制结合及跨语言迁移对性能至关重要。此外,模型对跨语言微调顺序及训练语言的语系相近性敏感。
原文摘要 · Abstract (English)
This paper presents our approach to the CheckThat! 2025 Task 1 on subjectivity detection, where systems are challenged to distinguish whether a sentence from a news article expresses the subjective view of the author or presents an objective view on the covered topic. We propose a feature-augmented transformer architecture that combines contextual embeddings from pre-trained language models with statistical and linguistic features. Our system leveraged pre-trained transformers with additional lexical features: for Arabic we used AraELECTRA augmented with part-of-speech (POS) tags and TF-IDF features, while for the other languages we fine-tuned a cross-lingual DeBERTa~V3 model combined with TF-IDF features through a gating mechanism. We evaluated our system in monolingual, multilingual, and zero-shot settings across multiple languages including English, Arabic, German, Italian, and several unseen languages. The results demonstrate the effectiveness of our approach, achieving competitive performance across different languages with notable success in the monolingual setting for English (rank 1st with macro-F1=0.8052), German (rank 3rd with macro-F1=0.8013), Arabic (rank 4th with macro-F1=0.5771), and Romanian (rank 1st with macro-F1=0.8126) in the zero-shot setting. We also conducted an ablation analysis that demonstrated the importance of combining TF-IDF features with the gating mechanism and the cross-lingual transfer for subjectivity detection. Furthermore, our analysis reveals the model's sensitivity to both the order of cross-lingual fine-tuning and the linguistic proximity of the training languages.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。