arXiv:2412.16725cs.AI2024-12被引 2

用逻辑框架提升大模型解决对话冲突能力

Enhancing Conflict Resolution in Language Models via Abstract Argumentation

  • 结合符号计算与语言模型,用抽象论证框架处理冲突
  • 带解释训练的模型在冲突解决上准确率更高
  • 适合需要透明推理的对话系统研发者

近年来,大语言模型(LLMs)在构建类人对话系统方面取得显著进展。然而,在共识建立和说服等任务中,面对不完整或不一致信息引发的冲突时,LLMs 常表现出局限性,暴露其在真实场景中的不足。为此,我们引入专门用于化解冲突与不一致的抽象论证(abstract argumentation)逻辑框架,旨在增强 LLMs 的冲突解决能力。为此,我们构建并整理了一个包含多样抽象论证框架的数据集,并附有论证可接受性计算过程的详细说明。随后,我们在该数据集上对 LLMs 进行微调,聚焦于抽象冲突解决任务。作为对比基准,我们还评估了基于思维链(chain-of-thought)的方法,但其在解决基于冲突的论证时效果不佳。实验表明,过程解释在学习中起关键作用:带有解释训练的模型相比仅使用问答对训练的模型展现出更优的泛化准确率。此外,利用 LLMs 的自解释能力,本方法可生成详尽推理说明,缓解神经网络通常缺乏透明性的缺陷。

原文摘要 · Abstract (English)

In recent years, large language models (LLMs) have made significant advancements in developing human-like and engaging dialogue systems. However, in tasks such as consensus-building and persuasion, LLMs often struggle to resolve conflicts arising from incomplete or inconsistent information, revealing their limitations in real-world applications. Given these limitations, abstract argumentation, a specialized logical framework designed to resolve conflicts and inconsistencies, becomes particularly relevant. In this paper, we aim to enhance the conflict-solving capabilities of LLMs by leveraging formal abstract argumentation, integrating language model learning with symbolic computation. To achieve this, we develop and curate a dataset comprising diverse abstract argumentation frameworks, accompanied by detailed explanations of the argument acceptability computation process. Subsequently, we fine-tune LLMs on this dataset, focusing on abstract conflict resolution tasks. As a comparative baseline, LLMs are also evaluated using a chain-of-thought approach, however, they fail to solve the conflict-based arguments effectively. Our experiments demonstrate that process explanations play a crucial role in learning. Models trained with explanations exhibit superior generalization accuracy compared to those trained solely on question-answer pairs. Furthermore, leveraging LLMs' self-explanation capabilities, our approach provides detailed illustrations that mitigate the lack of transparency typically associated with neural networks.

冲突解决逻辑推理大模型可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。