将对话转化为带动作标签的流程图,提升自动化流程提取效率
Dialog2Flow: Pre-training Soft-Contrastive Action-Driven Sentence Embeddings for Automatic Dialog Flow Extraction
- 用软对比损失训练对话嵌入,按语义功能分组说话内容
- 在20个任务导向数据集上预训练,可将对话转为动作序列
- 适合需要自动构建领域流程图的研究者和工程师
从无标注对话中高效提取结构化工作流仍是计算语言学中的未解难题。自动化该过程可显著加速新领域工作流的手动设计,并使大模型基于特定领域的流程图运行,提升透明度与可控性。本文提出对话到流程(Dialog2Flow, D2F)嵌入,不同于传统句子嵌入,它将话语映射到一个按沟通与信息功能(即所代表的动作)分组的潜在空间。D2F使对话在潜在空间中表现为具有特定动作区域的连续轨迹。通过对D2F嵌入聚类实现潜在空间量化,对话可转换为区域/动作编号序列,从而提取底层工作流。为预训练D2F,我们整合了20个任务导向对话数据集,并统一每轮动作标注。同时引入一种新颖的软对比损失,利用动作语义信息引导表示学习,性能优于标准监督对比损失。在多种对话嵌入模型上的评估显示,D2F在不同领域均取得更优定性和定量结果。
原文摘要 · Abstract (English)
Efficiently deriving structured workflows from unannotated dialogs remains an underexplored and formidable challenge in computational linguistics. Automating this process could significantly accelerate the manual design of workflows in new domains and enable the grounding of large language models in domain-specific flowcharts, enhancing transparency and controllability. In this paper, we introduce Dialog2Flow (D2F) embeddings, which differ from conventional sentence embeddings by mapping utterances to a latent space where they are grouped according to their communicative and informative functions (i.e., the actions they represent). D2F allows for modeling dialogs as continuous trajectories in a latent space with distinct action-related regions. By clustering D2F embeddings, the latent space is quantized, and dialogs can be converted into sequences of region/action IDs, facilitating the extraction of the underlying workflow. To pre-train D2F, we build a comprehensive dataset by unifying twenty task-oriented dialog datasets with normalized per-turn action annotations. We also introduce a novel soft contrastive loss that leverages the semantic information of these actions to guide the representation learning process, showing superior performance compared to standard supervised contrastive loss. Evaluation against various sentence embeddings, including dialog-specific ones, demonstrates that D2F yields superior qualitative and quantitative results across diverse domains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。