用BERT实现零样本对话状态追踪,快速适配新领域。
Candidate Attended Dialogue State Tracking Using BERT
- 基于预训练BERT构建多领域对话状态追踪框架
- 在SGD数据集上实现显著优于基线的性能
- 无需额外训练即可跨域迁移,适合低资源场景
对话状态追踪(DST)是任务导向对话系统的核心组件。每轮对话中,DST需估计用户信念或对话状态,作为下游模块预测系统动作和生成回复的输入。随着Google Assistant、Siri、Alexa等应用支持的服务和API数量不断增加,系统的可扩展性受到广泛关注。尤其对训练数据稀缺的领域,跨域知识迁移能力尤为重要。本文提出一种新型可扩展的多领域对话状态追踪框架,利用预训练BERT模型实现零样本泛化,使系统可在无需额外训练的情况下快速适应新领域。在最新发布的基于模式的对话(SGD)数据集上评估,模型性能显著优于先前基线。
原文摘要 · Abstract (English)
Dialogue state tracking (DST) is one of the core components in task-oriented dialogue systems. At each turn in a conversation, DST estimates the user belief or dialogue state, which is used as input for downstream modules to predict system actions and generate responses. The increasingly popular dialogue system applications like Google Assistant, Siri and Alexa need to support a large number of services and APIs, resulting in growing attention to the scalability of such systems. Especially for some domains with little or no training data, the capability of transferring existing knowledge of other domains is highly desired. In this paper, we present a novel scalable framework for multi-domain dialogue state tracking. The proposed system leverages the pretrained BERT model to achieve zero-shot generalization, making it easy to quickly adapt to new domains without additional training. The performance of our model is evaluated on recently released schema-based dialogue (SGD) dataset, showing significant improvement compared to previous baseline.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。