用可约束的符号神经架构,让对话系统零样本追踪状态更准更稳。
ReacTOD: Bounded Neuro-Symbolic Agentic NLU for Zero-Shot Dialogue State Tracking
- 将自然语言理解转化为受控工具调用,在自修正循环中逐步优化。
- 在MultiWOZ上比单次推理提升9.3个百分点,最大达52.71%联合目标准确率。
- 适合对可靠性要求高的客服、订票等实际应用,尤其适配小模型部署。
面向任务型对话系统(如订房、预约)需具备可预测行为,但为满足延迟要求而采用的中等规模大模型常出现幻觉和格式错误,导致错误操作(如订错日期)。本文提出ReacTOD,一种受限的神经符号架构,将自然语言理解重构为自修正ReAct循环中的离散工具调用,并由确定性验证器控制。受限的ReAct循环实现迭代自修正,在MultiWOZ上相较单次推理准确率提升最高达9.3个百分点。符号验证器在每次对话状态更新时强制执行动作合规、模式符合与指代一致,拦截错误后自修正率达93.1%,生成结构化执行轨迹。增量状态预测与按需历史检索使提示紧凑,实证提升参数受限模型的指令遵循能力。在MultiWOZ 2.1上,gpt-oss-20B达52.71%联合目标准确率,超越此前最佳14个百分点;Qwen3-8B仅用80亿参数即达47.34%。在Schema-Guided Dialogue(SGD)基准上,Claude-Opus-4.6达80.68% JGA,Qwen3-32B达64.09%,均无需特定任务训练数据,展现跨基准泛化能力。
原文摘要 · Abstract (English)
Task-oriented dialogue systems -- handling transactions, reservations, and service requests -- require predictable behavior, yet the moderately-sized LLMs needed for practical latency are prone to hallucination and format errors that cascade into incorrect actions (e.g., a hotel booked for the wrong date). We propose ReacTOD, a bounded neuro-symbolic architecture that reformulates NLU as discrete tool calls within a self-correcting ReAct loop governed by deterministic validation. A bounded ReAct loop enables iterative self-correction, improving accuracy by up to 9.3 percentage points over single-pass inference on MultiWOZ. A symbolic validator enforces action compliance, schema conformance, and coreference consistency on every dialogue state update, achieving a 93.1% self-correction rate on intercepted errors and producing structured execution traces. Incremental state prediction and on-demand history retrieval keep prompts compact, empirically improving instruction adherence in parameter-constrained models. On MultiWOZ 2.1, ReacTOD achieves a new zero-shot state-of-the-art: gpt-oss-20B reaches 52.71% joint goal accuracy, surpassing the previous best by 14 percentage points, while Qwen3-8B achieves 47.34% with only 8B parameters. On the Schema-Guided Dialogue (SGD) benchmark, ReacTOD with Claude-Opus-4.6 achieves 80.68% JGA under fully end-to-end evaluation with predicted domains, and Qwen3-32B reaches 64.09% -- demonstrating cross-benchmark generalization without task-specific training data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。