用图结构+专家路由+推理智能体,提升对话状态跟踪准确率
GEM: Graph-Enhanced Mixture-of-Experts with ReAct Agents for Dialogue State Tracking

- 引入图神经网络和T5专家,由智能路由器动态分配任务
- 在MultiWOZ 2.2上达到65.19%联合目标准确率,超越现有方法
- 适合需要高精度对话理解的系统研发人员参考
对话状态跟踪(DST)需从多领域对话中精确提取结构化信息,尽管大语言模型(LLMs)具备强大泛化能力,但在该任务上表现不佳。我们提出GEM(图增强的专家混合模型),融合语言模型与图结构对话理解,并引入基于ReAct的智能体进行结构化推理,以实现更优的DST性能。该方法动态调度两个专业专家:一个图神经网络用于捕捉对话结构与轮次依赖关系,一个微调后的T5-Small编码器-解码器用于序列建模,二者由智能路由协调。针对复杂值生成任务,引入ReAct智能体,在对话上下文中执行结构化推理。在MultiWOZ 2.2数据集上,GEM取得65.19%的联合目标准确率,显著优于端到端LLM方法(最高38.43%),并超越当前最优方法TOATOD(63.79%)、D3ST(58.70%)和Diable(56.48%)。结果表明,结合结构化对话表示、动态专家路由与智能体推理的框架,不仅提升准确性,还通过选择性激活专家保持计算效率。
原文摘要 · Abstract (English)
Dialogue State Tracking (DST) requires precise extraction of structured information from multi-domain conversations, a task where Large Language Models (LLMs) struggle despite their impressive general capabilities. We present GEM (Graph-Enhanced Mixture-of-Experts), a novel framework that combines language models and graph-structured dialogue understanding with ReAct agent-based reasoning for superior DST performance. Our approach dynamically routes between specialized experts: a Graph Neural Network that captures dialogue structure and turn-level dependencies, and a finetuned T5-Small encoder-decoder for sequence modeling, coordinated by an intelligent router. For complex value generation tasks, we integrate ReAct agents that perform structured reasoning over dialogue context. On MultiWOZ 2.2, GEM achieves 65.19% Joint Goal Accuracy, substantially outperforming end-to-end LLM approaches (best: 38.43%) and surpassing state-of-the-art (SOTA) methods including TOATOD (63.79%), D3ST (58.70%), and Diable (56.48%). Our graph-enhanced mixture-of-experts architecture with ReAct integration demonstrates that combining structured dialogue representation with dynamic expert routing and agent-based reasoning provides a powerful paradigm for dialogue state tracking, achieving superior accuracy while maintaining computational efficiency through selective expert activation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。