arXiv:2608.27471cs.AIcs.CL2026-08

用外部知识动态检索论点关系,提升政治辩论中的谬误检测能力

Retrieving Relations, Detecting Fallacies: A RAG Approach to Political Debate Analysis

  • 基于支持/攻击关系引导检索,动态获取相关背景知识
  • 在ElecDeb60to20上达到0.864的宏平均F1,优于基线
  • 适合需要可解释性与高精度的舆情分析场景

谬误是采用无效推理的论证,在高风险政治辩论等敏感场景中自动识别至关重要。识别谬误需超越表面文本的上下文知识,包括议题相关的世界知识以及论点间的逻辑关系。已有研究显示,论辩结构有助于提升分类性能,但通常仅作为静态特征编码,灵活性不足。为此,本文提出一种受引导的检索增强方法,利用支持与攻击关系动态引导文档检索,从15GB的政治类文档知识库中提取相关信息。在ElecDeb60to20基准上,覆盖42种检索配置和14种模型,该方法将谬误检测的宏平均F1提升至0.864,分类任务达0.725,显著优于非检索基线。结果表明,经论辩引导的外部知识检索能有效提升谬误识别效果。

原文摘要 · Abstract (English)

Fallacies are arguments that employ invalid reasoning, making their automatic detection critical in sensitive contexts such as high-stakes political debates, where public opinion is shaped. Spotting a fallacious argument requires contextual knowledge beyond its pure surface text. This entails world knowledge pertaining to the subject matter under discussion, as well as knowledge of the relationships that exist between arguments within the argumentative discourse. Prior work on fallacy analysis has shown that argumentative discourse structure can beneficially improve classification performance. However, such structure is typically encoded only as static classifier features, limiting its flexibility. Building on this intuition while addressing this limitation, we introduce a guided retrieval-augmented methodology for fallacy detection and classification that leverages argumentative relations of support and attack to dynamically steer the extraction of relevant documents. We evaluate our approach on the ElecDeb60to20 benchmark across 42 retrieval configurations and 14 models, performing retrieval over a 15GB knowledge base of collected political-related documents. Our approach improves macro-F1 up to 0.864 for fallacy detection and up to 0.725 for classification over non-retrieval baselines. These results show that incorporating external knowledge significantly enhances fallacy detection and classification when retrieval is argumentatively guided.

谬误检测检索增强政治辩论论辩分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。