改用模型直接预测结果,大幅提升数独等离散约束任务的正确率。
Let It Go or Learn to Self-Correct: Continuous Diffusion for Constrained Discrete Tasks

- 跳过逐步去噪,直接采样模型干净预测结果
- 数独有效率从31%提升至95%,其他任务也显著改善
- 适合需要全局约束的离散推理任务研究者
去噪扩散概率模型通过从噪声开始反复去噪生成样本,这一过程在连续域表现良好,但在需全局约束的离散任务(如数独、图连通性、拉丁方、N皇后)中效果受限。早期离散错误难以修正,标准采样会固化错误。我们对比标准采样与直接使用模型干净预测的采样方式,无需重训练,数独有效率即从31%提升至95%,其他任务亦有稳定增益。我们推测,保持与当前噪声状态接近会偏离模型训练时的前向加噪分布,造成训练-测试不匹配。为此引入自校正训练,让模型接触自身预测,增强推理时纠错能力,显著提升标准采样性能。结果表明,连续扩散模型可学习复杂全局约束,但离散推理需更好对齐训练与推理:或采用减少早期决策依赖的采样器,或通过训练教会模型自我纠正。
原文摘要 · Abstract (English)
Denoising Diffusion Probabilistic Models (DDPMs) generate samples by starting from noise and repeatedly denoising while keeping each update close to the current noisy state. This behavior is effective in many continuous domains, but its role is less clear for globally constrained discrete tasks, such as Sudoku, graph connectivity, Latin squares, and N-queens. In such settings, early discrete errors can be difficult to undo. As a result, standard diffusion sampling may preserve early mistakes, even when the model's clean predictions are informative. We compare standard samplers to sampling directly from the model's clean prediction. Without retraining, this single change improves Sudoku validity from 31% to 95%, with consistent gains across the other discrete tasks. We hypothesize that staying close to the current noisy state is harmful because the reverse trajectory can drift off the forward noising distribution the model was trained on. To reduce this train-test mismatch, we further introduce self-correction training, which exposes the model to its own predictions, improving robustness to errors that arise during inference. This substantially improves the performance of standard samplers. Our results suggest that continuous diffusion models can learn nontrivial global constraints, but discrete reasoning tasks require better alignment between training and inference: either through samplers that reduce commitment to early decisions, or through training that teaches the model to correct its own inference-time errors.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。