让生成模型严格满足线性约束,同时保持生成质量。
Deep Generative Models with Hard Linear Equality Constraints
- 提出可微分的梯度估计器,实现约束分布的精准学习。
- 在5个图像数据集和3个科学应用中,生成数据100%满足约束。
- 相比其他方法,生成结果更真实,适合需严格遵守物理规律的场景。
尽管深度生成模型在捕捉复杂数据分布方面表现卓越,但始终无法有效学习编码领域知识的约束,导致必须引入约束整合机制。现有解决方案多依赖启发式方法,常忽略底层数据分布,损害生成性能。本文提出一种概率上严谨的方法,将硬约束嵌入深度生成模型,生成既符合约束又逼真的数据。通过设计可微分的梯度估计器,使条件于约束的数据分布得以端到端训练。我们在五个图像数据集及三个科学应用场景(均受线性等式约束)中开展广泛实验。结果表明,标准生成模型几乎必然生成违反约束的数据。在所有约束整合策略中,本方法不仅确保生成数据100%满足约束,且在所有基准测试中均优于其他方法,显著提升生成性能。
原文摘要 · Abstract (English)
While deep generative models~(DGMs) have demonstrated remarkable success in capturing complex data distributions, they consistently fail to learn constraints that encode domain knowledge and thus require constraint integration. Existing solutions to this challenge have primarily relied on heuristic methods and often ignore the underlying data distribution, harming the generative performance. In this work, we propose a probabilistically sound approach for enforcing the hard constraints into DGMs to generate constraint-compliant and realistic data. This is achieved by our proposed gradient estimators that allow the constrained distribution, the data distribution conditioned on constraints, to be differentiably learned. We carry out extensive experiments with various DGM model architectures over five image datasets and three scientific applications in which domain knowledge is governed by linear equality constraints. We validate that the standard DGMs almost surely generate data violating the constraints. Among all the constraint integration strategies, ours not only guarantees the satisfaction of constraints in generation but also archives superior generative performance than the other methods across every benchmark.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。