arXiv:2510.03442cs.LGcs.AI2025-10

用结构化论证提升AI可信度,让推理过程可验证、可迭代。

The Argument is the Explanation: Structured Argumentation for Trust in Agents

  • 将大模型输出转为可验证的论证图,支持每步推理审查。
  • 在AAEC数据集上达94.44宏F1,比之前高5.7点。
  • 适合需要高可信决策的场景,如多智能体风险评估。

人类是黑箱——我们无法观察其神经过程,但社会仍能通过可验证的论据进行运作。人工智能可解释性应遵循此原则:利益相关方需要的是可验证的推理链条,而非机制透明。我们提出使用结构化论证,提供解释与验证能力,这是现有可解释性方法和大模型生成解释无法实现的。我们的流程在发布的AAEC训练/测试集上达到94.44的宏F1(比之前高出5.7点),在类似数据设置下,对论辩型微文本关系分类任务获得0.81的宏F1(约高于先前结果0.07)。该方法将大模型文本转化为论证图,支持每一步推理的验证。我们在多智能体风险评估中应用结构化“如果-会怎样”技术,使专业智能体协作完成原本仅由人类完成的风险评估。采用双极假设基论证框架,捕捉支持与攻击关系,从而通过事实节点自动检测幻觉。还提供了无需重训练即可通过测试时反馈进行迭代优化的验证机制。为便于部署,我们提供了微调后的AMT模型的Docker容器,其余代码及Bipolar ABA Python包已开源于GitHub。

原文摘要 · Abstract (English)

Humans are black boxes -- we cannot observe their neural processes, yet society functions by evaluating verifiable arguments. AI explainability should follow this principle: stakeholders need verifiable reasoning chains, not mechanistic transparency. We propose using structured argumentation to provide a level of explanation and verification neither interpretability nor LLM-generated explanation is able to offer. Our pipeline achieves state-of-the-art 94.44 macro F1 on the AAEC published train/test split (5.7 points above prior work) and $0.81$ macro F1, $\sim$0.07 above previous published results with comparable data setups, for Argumentative MicroTexts relation classification, converting LLM text into argument graphs and enabling verification at each inferential step. We demonstrate this idea on multi-agent risk assessment using the Structured What-If Technique, where specialized agents collaborate transparently to carry out risk assessment otherwise achieved by humans alone. Using Bipolar Assumption-Based Argumentation, we capture support/attack relationships, thereby enabling automatic hallucination detection via fact nodes attacking arguments. We also provide a verification mechanism that enables iterative refinement through test-time feedback without retraining. For easy deployment, we provide a Docker container for the fine-tuned AMT model, and the rest of the code with the Bipolar ABA Python package on GitHub.

AI可信结构化论证多智能体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。