arXiv:2410.04239cs.CL2024-10中稿 · ECAI 2024

用聊天机器人模拟观众人格,提升辩论说服力评估效果

Persona Knowledge-Aligned Prompt Tuning Method for Online Debate

  • 用ChatGPT生成观众人格特征,通过提示词微调注入小模型
  • 在辩论质量评估任务中显著优于现有方法,提升稳定
  • 适合研究人机交互、个性化对话系统的学者参考

辩论是就特定议题交换观点或说服他人的过程。近期研究表明,论点的说服力不仅取决于语言表达,还与沟通者特征密切相关。尽管学界关注语言特征和话语结构,但将论点说服力与受众社会人格结合的研究仍受限于复杂性。我们观察到ChatGPT表现出强大的模拟与人格化能力,表明大型预训练语言模型可作为具有独特背景知识的个体,产生差异化影响。为此,我们提出一种从受众视角出发的论点质量评估框架,首次利用ChatGPT的涌现能力,通过提示词微调将受众人格知识注入小型语言模型。该方法在多项指标上均实现显著且一致的性能提升。

原文摘要 · Abstract (English)

Debate is the process of exchanging viewpoints or convincing others on a particular issue. Recent research has provided empirical evidence that the persuasiveness of an argument is determined not only by language usage but also by communicator characteristics. Researchers have paid much attention to aspects of languages, such as linguistic features and discourse structures, but combining argument persuasiveness and impact with the social personae of the audience has not been explored due to the difficulty and complexity. We have observed the impressive simulation and personification capability of ChatGPT, indicating a giant pre-trained language model may function as an individual to provide personae and exert unique influences based on diverse background knowledge. Therefore, we propose a persona knowledge-aligned framework for argument quality assessment tasks from the audience side. This is the first work that leverages the emergence of ChatGPT and injects such audience personae knowledge into smaller language models via prompt tuning. The performance of our pipeline demonstrates significant and consistent improvement compared to competitive architectures.

辩论系统人格建模提示微调

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。