用理论增强大模型,精准识别话语重述的修辞功能
On Theoretically-Driven LLM Agents for Multi-Dimensional Discourse Analysis
- 构建多智能体框架,用理论知识提升重述功能识别能力
- 理论增强模型在强重述与泛化场景中表现显著更优,宏平均F1提升近30%
- 适合研究修辞分析、论辩计算与可解释AI的学者使用
识别话语中重述的策略性用途仍是计算论辩的核心挑战。尽管大语言模型能检测表面相似性,却难以捕捉重述的语用功能,如其在修辞论述中的作用。本文提出一种对比式多智能体框架,用于量化引入显式理论知识对该任务的增益。我们利用标注的政治辩论数据集建立新标准,涵盖四种重述功能:去强化(Deintensification)、强化(Intensification)、具体化(Specification)、泛化(Generalisation),以及其它(Other),统称为D-I-S-G-O。随后评估两个并行的基于LLM的智能体系统:一个通过检索增强生成(RAG)融入论辩理论,另一个为零样本基线。结果表明,理论增强型智能体全面优于基线,尤其在强化与泛化语境中优势显著,整体宏平均F1得分提升近30%。研究证实,理论奠基不仅有益,更是实现功能感知的论辩话语分析所必需。该对比式多智能体架构为可扩展、理论驱动的计算工具迈出关键一步。
原文摘要 · Abstract (English)
Identifying the strategic uses of reformulation in discourse remains a key challenge for computational argumentation. While LLMs can detect surface-level similarity, they often fail to capture the pragmatic functions of rephrasing, such as its role within rhetorical discourse. This paper presents a comparative multi-agent framework designed to quantify the benefits of incorporating explicit theoretical knowledge for this task. We utilise an dataset of annotated political debates to establish a new standard encompassing four distinct rephrase functions: Deintensification, Intensification, Specification, Generalisation, and Other, which covers all remaining types (D-I-S-G-O). We then evaluate two parallel LLM-based agent systems: one enhanced by argumentation theory via Retrieval-Augmented Generation (RAG), and an identical zero-shot baseline. The results reveal a clear performance gap: the RAG-enhanced agents substantially outperform the baseline across the board, with particularly strong advantages in detecting Intensification and Generalisation context, yielding an overall Macro F1-score improvement of nearly 30\%. Our findings provide evidence that theoretical grounding is not only beneficial but essential for advancing beyond mere paraphrase detection towards function-aware analysis of argumentative discourse. This comparative multi-agent architecture represents a step towards scalable, theoretically informed computational tools capable of identifying rhetorical strategies in contemporary discourse.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。