用专家混合模型提升立场检测,精准识别作者对隐含地缘政治角色的立场。
StanceMoE: Mixture-of-Experts Architecture for Stance Detection
- 设计六类专家模块,分别捕捉语义倾向、关键词、句法焦点等语言信号
- 在StanceNakba 2026数据集上达94.26%宏F1,超越传统方法和BERT变体
- 适合需要细粒度立场分析的舆情监控与地缘政治文本研究者
针对作者对文本中提及或牵涉的地缘政治实体所持立场的判断任务,现有基于Transformer的模型多依赖统一表示,难以充分捕捉对比性话语结构、框架线索及显著词汇特征等异质语言信号。为此,本文提出StanceMoE,一种基于微调BERT编码器的上下文增强型专家混合(MoE)架构。模型集成六类专家模块,分别对应全局语义倾向、显著词汇线索、分句级关注点、短语级模式、框架指示符以及对比驱动的话语转换。通过上下文感知门控机制,动态加权专家输出,实现输入特征自适应路由。在包含1,401条标注英文文本的StanceNakba 2026子任务A数据集上,该模型取得94.26%的宏F1分数,显著优于传统基线及其它BERT衍生模型。
原文摘要 · Abstract (English)
Actor-level stance detection aims to determine an author expressed position toward specific geopolitical actors mentioned or implicated in a text. Although transformer-based models have achieved relatively good performance in stance classification, they typically rely on unified representations that may not sufficiently capture heterogeneous linguistic signals, such as contrastive discourse structures, framing cues, and salient lexical indicators. This motivates the need for adaptive architectures that explicitly model diverse stance-expressive patterns. In this paper, we propose StanceMoE, a context-enhanced Mixture-of-Experts (MoE) architecture built upon a fine-tuned BERT encoder for actor-level stance detection. Our model integrates six expert modules designed to capture complementary linguistic signals, including global semantic orientation, salient lexical cues, clause-level focus, phrase-level patterns, framing indicators, and contrast-driven discourse shifts. A context-aware gating mechanism dynamically weights expert contributions, enabling adaptive routing based on input characteristics. Experiments are conducted on the StanceNakba 2026 Subtask A dataset, comprising 1,401 annotated English texts where the target actor is implicit in the text. StanceMoE achieves a macro-F1 score of 94.26%, outperforming traditional baselines, and alternative BERT-based variants.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。