用大模型自动生成多样化面试模拟人格,提升对话系统测试效率
Generating Diverse Personas for User Simulators to Test Interview Dialogue Systems
- 用大语言模型自动生成用户模拟器的人格设定
- 生成语句多样性显著提升,覆盖更广沟通风格
- 适合需要大规模测试的对话系统研发团队
本文针对面试对话系统测试中人力成本高的问题提出解决方案。由于传统用户模拟器多用于训练任务导向型对话系统,对模拟用户人格关注不足,而开发阶段需覆盖广泛用户行为,手动创建大量人格极为耗时。本文提出基于大语言模型的自动人格生成方法,并在生成过程中引入与沟通风格相关的人格特质,以增强模拟器的多样性。实验表明,该方法使用户模拟器生成的语句具有更高变异性,有效提升了测试覆盖面。
原文摘要 · Abstract (English)
This paper addresses the issue of the significant labor required to test interview dialogue systems. While interview dialogue systems are expected to be useful in various scenarios, like other dialogue systems, testing them with human users requires significant effort and cost. Therefore, testing with user simulators can be beneficial. Since most conventional user simulators have been primarily designed for training task-oriented dialogue systems, little attention has been paid to the personas of the simulated users. During development, testing interview dialogue systems requires simulating a wide range of user behaviors, but manually creating a large number of personas is labor-intensive. We propose a method that automatically generates personas for user simulators using a large language model. Furthermore, by assigning personality traits related to communication styles when generating personas, we aim to increase the diversity of communication styles in the user simulator. Experimental results show that the proposed method enables the user simulator to generate utterances with greater variation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。