用逻辑角色引导去噪,让语言模型零样本推理更准
LogicDiff: Logic-Guided Denoising Improves Zero-Shot Reasoning in Masked Diffusion Language Models
- 根据逻辑角色预测选择优先还原的词,而非仅靠置信度
- 零样本下数学题准确率从22%提至60.7%,提升38.7个百分点
- 适合零样本推理场景,尤其对缺乏提示的模型有显著帮助
掩码扩散语言模型(MDLMs)通过逐步解掩码生成文本。其默认基于置信度的解掩码策略会系统性延迟高熵逻辑连接词,导致推理性能下降。我们提出LogicDiff,一种推理时方法,以逻辑角色引导取代置信度驱动的解掩码。一个轻量级分类头(420万参数,占基础模型0.05%)从基础模型隐藏状态中以98.4%准确率预测每个掩码位置的逻辑角色(前提、连接词、推导步骤、结论或填充),并由依赖顺序调度器按逻辑顺序解掩码。在零样本设置下,LogicDiff将LLaDA-8B-Instruct在GSM8K上的准确率从22.0%提升至60.7%(+38.7百分点),在MATH-500上从23.6%提升至29.2%(+5.6百分点),速度开销低于6%。但使用8样本思维链提示时,基线已接近70%,LogicDiff不再带来提升。分析表明,少样本提示隐式解决了LogicDiff显式处理的排序问题,且固定角色顺序可能在充分上下文前过早锁定数值。结果揭示‘灵活性陷阱’主要为零样本现象,并指出上下文自适应排序是未来关键方向。
原文摘要 · Abstract (English)
Masked diffusion language models (MDLMs) generate text by iteratively unmasking tokens from a fully masked sequence. Their standard confidence-based unmasking strategy systematically defers high-entropy logical connective tokens, degrading reasoning performance. We introduce LogicDiff, an inference-time method that replaces confidence-based unmasking with logic-role-guided unmasking. A lightweight classification head (4.2M parameters, 0.05% of the base model) predicts the logical role of each masked position (premise, connective, derived step, conclusion, or filler) from the base model's hidden states with 98.4% accuracy, and a dependency-ordered scheduler unmasks tokens in logical order. In zero-shot settings, LogicDiff improves LLaDA-8B-Instruct accuracy from 22.0% to 60.7% on GSM8K (+38.7 percentage points) and from 23.6% to 29.2% on MATH-500 (+5.6 pp), with less than 6% speed overhead. However, with 8-shot chain-of-thought prompting, the baseline reaches approximately 70% and LogicDiff provides no additional improvement. Analysis reveals that few-shot prompting implicitly resolves the same ordering problem that LogicDiff explicitly addresses, and that fixed role-based ordering can cause premature commitment to numerical values before sufficient context is available. Our results characterize the Flexibility Trap as primarily a zero-shot phenomenon and identify context-adaptive ordering as a key direction for future work.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。