用开源大模型跨语言生成多语种对话,无需翻译或示例。
Open-Source Large Language Models as Multilingual Crowdworkers: Synthesizing Open-Domain Dialogues in Several Languages With No Examples in Targets and No Machine Translation
- 用大模型直接生成多语言对话,不依赖机器翻译。
- 在PersonaChat数据集上实现跨语言对话生成,保留语言特色。
- 适合需要低成本多语种对话数据的研究者使用。
当前开放域对话系统主要聚焦英语,且多语言数据收集需耗费大量资金与时间。得益于大语言模型(LLM)的发展,特别是指令微调使模型能根据自然语言指令完成任务,有时甚至超越人类众包工人的表现,且支持单线程内多种语言共存。本文提出一种无需目标语言示例和机器翻译的多语言对话生成流程,利用源语言的示范生成多种目标语言的对话数据。该方法通过避免显式翻译,更好地保留语言特异性。研究以PersonaChat数据集为例,引入说话事件(如闲聊、讨论)和共同前提(common ground)概念,增强生成对话的真实性和开放性。
原文摘要 · Abstract (English)
The prevailing paradigm in the domain of Open-Domain Dialogue agents predominantly focuses on the English language, encompassing both models and datasets. Furthermore, the financial and temporal investments required for crowdsourcing such datasets for finetuning are substantial, particularly when multiple languages are involved. Fortunately, advancements in Large Language Models (LLMs) have unveiled a plethora of possibilities across diverse tasks. Specifically, instruction-tuning has enabled LLMs to execute tasks based on natural language instructions, occasionally surpassing the performance of human crowdworkers. Additionally, these models possess the capability to function in various languages within a single thread. Consequently, to generate new samples in different languages, we propose leveraging these capabilities to replicate the data collection process. We introduce a pipeline for generating Open-Domain Dialogue data in multiple Target Languages using LLMs, with demonstrations provided in a unique Source Language. By eschewing explicit Machine Translation in this approach, we enhance the adherence to language-specific nuances. We apply this methodology to the PersonaChat dataset. To enhance the openness of generated dialogues and mimic real life scenarii, we added the notion of speech events corresponding to the type of conversation the speakers are involved in and also that of common ground which represents the premises of a conversation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。