arXiv:2603.09691cs.CLcs.AI2026-03

统一指令微调框架,让对话模型更好理解任务与数据结构。

ESAinsTOD: A Unified End-to-End Schema-Aware Instruction-Tuning Framework for Task-Oriented Dialog Modeling

  • 用指令与模式对齐机制,让大模型精准执行多场景任务流程。
  • 在多个数据集上超越现有方法,零样本泛化能力显著提升。
  • 适合需要跨领域、低资源部署的智能对话系统研发者。

现有端到端任务导向对话建模方法通常针对特定数据集设计,难以适应新对话场景。本文提出ESAinsTOD,一种统一的端到端模式感知指令微调框架,用于通用任务导向对话建模。该框架采用全参数微调大语言模型,并引入两种对齐机制:(i) 指令对齐,确保系统忠实遵循任务指令完成异构数据集中的多样化任务流程;(ii) 模式对齐,促使系统预测结果符合指定模式结构。同时,采用会话级端到端建模,使系统能利用对话历史中先前任务的结果,弥合指令微调范式与真实应用之间的差距。实验表明:(i) ESAinsTOD在CamRest676、In-Car和MultiWOZ等基准上显著优于现有最先进模型;(ii) 在多种低资源设置下展现出优越泛化能力,所提对齐机制显著提升零样本性能;(iii) 指令微调范式大幅增强模型对数据噪声和级联错误的鲁棒性。

原文摘要 · Abstract (English)

Existing end-to-end modeling methods for modular task-oriented dialog systems are typically tailored to specific datasets, making it challenging to adapt to new dialog scenarios. In this work, we propose ESAinsTOD, a unified End-to-end Schema-Aware Instruction-tuning framework for general Task-Oriented Dialog modeling. This framework introduces a structured methodology to go beyond simply fine-tuning Large Language Models (LLMs), enabling flexible adaptation to various dialogue task flows and schemas. Specifically, we leverage full-parameter fine-tuning of LLMs and introduce two alignment mechanisms to make the resulting system both instruction-aware and schema-aware: (i) instruction alignment, which ensures that the system faithfully follows task instructions to complete various task flows from heterogeneous TOD datasets; and (ii) schema alignment, which encourages the system to make predictions adhering to the specified schema. In addition, we employ session-level end-to-end modeling, which allows the system to access the results of previously executed task flows within the dialogue history, to bridge the gap between the instruction-tuning paradigm and the real-world application of TOD systems. Empirical results show that while a fine-tuned LLM serves as a strong baseline, our structured approach provides significant additional benefits. In particular, our findings indicate that: (i) ESAinsTOD outperforms state-of-the-art models by a significant margin on end-to-end task-oriented dialog modeling benchmarks: CamRest676, In-Car and MultiWOZ; (ii) more importantly, it exhibits superior generalization capabilities across various low-resource settings, with the proposed alignment mechanisms significantly enhancing zero-shot performance; and (iii) our instruction-tuning paradigm substantially improves the model's robustness against data noise and cascading errors.

对话系统指令微调大模型零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。