arXiv:2502.13592cs.CL2025-02AAAI被引 2

用大模型生成带约束的多人群聊,更灵活也更真实。

Don't Stop the Multi-Party! On Generating Synthetic Written Multi-Party Conversations with Constraints

  • 分步生成对话,每轮由模型扮演一人发言
  • 分步策略更符合设定规则,语言更丰富多样
  • 适合需要可控多人群聊数据的研究者

书面多人群聊(WMPCs)在多个领域受到关注,社交平台是主要数据来源,但存在隐私问题且受平台结构限制,导致互动模式单一。本文探索使用指令微调的大语言模型生成带约束的合成多人群聊,通过设定对话结构和参与者立场等确定性约束。提出两种策略:一是让大模型一次性生成完整对话;二是让模型逐轮生成,每次输出发言者、接收者和内容,并基于历史上下文。设计评估框架,从约束遵守度、内容质量、互动复杂性三方面分析。人类与大模型评分均显示,不同模型表现差异显著,仅部分能生成高质量对话。分步生成在约束符合度和语言多样性上优于整体生成,但两种方式均可产出高质量结果。

原文摘要 · Abstract (English)

Written Multi-Party Conversations (WMPCs) are widely studied across disciplines, with social media as a primary data source due to their accessibility. However, these datasets raise privacy concerns and often reflect platform-specific properties. For example, interactions between speakers may be limited due to rigid platform structures (e.g., threads, tree-like discussions), which yield overly simplistic interaction patterns (e.g., one-to-one "reply-to" links). This work explores the feasibility of generating synthetic WMPCs with instruction-tuned Large Language Models (LLMs) by providing deterministic constraints such as dialogue structure and participants' stance. We investigate two complementary strategies of leveraging LLMs in this context: (i.) LLMs as WMPC generators, where we task the LLM to generate a whole WMPC at once and (ii.) LLMs as WMPC parties, where the LLM generates one turn of the conversation at a time (made of speaker, addressee and message), provided the conversation history. We next introduce an analytical framework to evaluate compliance with the constraints, content quality, and interaction complexity for both strategies. Finally, we assess the level of obtained WMPCs via human and LLM-as-a-judge evaluations. We find stark differences among LLMs, with only some being able to generate high-quality WMPCs. We also find that turn-by-turn generation yields better conformance to constraints and higher linguistic variability than generating WMPCs in one pass. Nonetheless, our structural and qualitative evaluation indicates that both generation strategies can yield high-quality WMPCs.

多人群聊大模型生成对话控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。