用确定性扩散轨迹优化约束条件下的预测结果
Constraint-Guided Prediction Refinement via Deterministic Diffusion Trajectories
- 基于扩散模型的确定性迭代路径,逐步修正初始预测
- 在表格数据攻击和电力流预测中均显著提升约束满足度
- 可后置应用,适合需强约束的各类模型
许多现实世界的机器学习任务需要输出满足硬约束,如物理守恒定律、图结构依赖关系或表格数据的列级关联。现有方法依赖领域特定架构或对约束空间的强假设,限制于线性或凸约束。本文提出一种通用的约束感知精炼框架,利用去噪扩散隐式模型(DDIMs)。从粗略预测出发,通过由学习到的先验引导并结合约束梯度修正的确定性扩散轨迹进行迭代精炼。该方法适用于广泛的非凸、非线性等式约束,且可后置应用于任意基础模型。我们在两个代表性场景中验证:具有列级依赖的表格数据约束对抗攻击生成,以及满足基尔霍夫定律的交流电功率流预测。在两种设置下,扩散引导精炼均显著提升了约束满足度与性能,同时保持轻量与模型无关。
原文摘要 · Abstract (English)
Many real-world machine learning tasks require outputs that satisfy hard constraints, such as physical conservation laws, structured dependencies in graphs, or column-level relationships in tabular data. Existing approaches rely either on domain-specific architectures and losses or on strong assumptions on the constraint space, restricting their applicability to linear or convex constraints. We propose a general-purpose framework for constraint-aware refinement that leverages denoising diffusion implicit models (DDIMs). Starting from a coarse prediction, our method iteratively refines it through a deterministic diffusion trajectory guided by a learned prior and augmented by constraint gradient corrections. The approach accommodates a wide class of non-convex and nonlinear equality constraints and can be applied post hoc to any base model. We demonstrate the method in two representative domains: constrained adversarial attack generation on tabular data with column-level dependencies and in AC power flow prediction under Kirchhoff's laws. Across both settings, our diffusion-guided refinement improves both constraint satisfaction and performance while remaining lightweight and model-agnostic.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。