arXiv:2606.15770cs.CL2026-06ACL

用结构化思维链提示检测政治回避策略,效果优于微调模型。

ttda704 at SemEval-2026 Task 6: Structured Chain-of-Thought Prompting for Political Evasion Detection

论文配图:ttda704 at SemEval-2026 Task 6: Structured Chain-of-Thought Prompting for Political Evasion Detection
图 1 · 摘自论文原文
  • 采用分层思维链提示,引导大模型逐步分析问答中的回避意图。
  • 在9类回避任务中达0.5147的宏平均F1,3类清晰度任务达0.7979。
  • 适合关注政治话语分析、可解释性推理的研究者使用。

本文介绍我们在SemEval-2026任务6中的系统,旨在对美国总统访谈中提取的英文问答对进行政治回避策略分类。我们对比了两种范式:(1) 使用QLoRA对Qwen3(4B-32B)模型进行参数高效微调,结合分层上采样与加权交叉熵损失缓解严重类别不平衡;(2) 对具备推理能力的API模型(DeepSeek-V3.2、Grok-4-Fast)采用结构化思维链(CoT)提示。评估表明,结构化CoT提示显著优于基线微调方法,在宏平均F1上表现更优。最佳系统为使用扩展推理与少量样本分层CoT提示的Grok-4-Fast,其在子任务2(9类回避)中获得0.5147的宏平均F1,子任务1(3类清晰度)达0.7979,分别在33支队伍和41支队伍中排名第8和第13。消融实验揭示:在层级分类体系中呈现标签有助于模型推理结构化,少量示例可实现任务校准。但最强提示变体间宏观F1无统计差异,开启扩展推理模式显著提升性能,因能支持多步语用分析以识别回避意图。

原文摘要 · Abstract (English)

This paper describes our system for SemEval-2026 Task 6, which addresses the classification of political evasion strategies in English question-answer pairs extracted from U.S. presidential interviews. We systematically compare two distinct paradigms: (1) Parameter-Efficient Fine-Tuning of Qwen3 models (4B-32B) using QLoRA, enhanced with tiered upsampling and weighted cross-entropy loss to address severe class imbalance, and (2) structured Chain-of-Thought (CoT) prompting of reasoning-capable API models, namely DeepSeek-V3.2 and Grok-4-Fast. Our evaluation demonstrates that structured CoT prompting of reasoning-enabled models substantially outperforms our baseline parameter-efficient fine-tuning implementation in absolute Macro F1. Our best system, Grok-4-Fast with extended reasoning and few-shot hierarchical CoT prompting, achieves a Macro F1 of 0.5147 on Subtask 2 (9-class evasion) and 0.7979 on Subtask 1 (3-class clarity), ranking 8th out of 33 teams on Subtask 2 and 13th out of 41 teams on Subtask 1 on the official leaderboard. Furthermore, our ablation studies reveal key insights into effective prompt design for evasion detection: presenting labels within a hierarchical taxonomy helps structure model reasoning, while few-shot exemplars provide task calibration. However, the strongest prompt variants are not statistically distinguishable in Macro F1, and explicitly enabling extended reasoning modes yields substantial performance gains by facilitating the multi-step pragmatic analysis required to detect evasive intent.

政治分析思维链大模型回避检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。