用哥德尔逻辑实现可微的离散搜索,解决神经符号系统中的布尔可满足性问题。
Gradient-Based Optimization on Gödel Logic as Discrete Local Search
- 基于哥德尔语义构建可微离散变量编码,保持逻辑结构一致性。
- 优化每一步精准修改未满足子句中的一个变量,等价于离散求解器步骤。
- 引入随机重参数化技巧提升搜索空间探索能力,适合组合优化任务。
神经符号系统在连续梯度优化中面临离散逻辑域的挑战。尽管模糊松弛能提供可微性,但常缺乏与经典逻辑的形式对齐。本文提出,哥德尔语义通过同态将连续解释映射为布尔解释,使离散变量可编码且全程可微。基于此,我们证明哥德尔逻辑上的梯度优化等价于布尔可满足性的离散局部搜索。理论分析表明,每步优化均定位并修改一个未满足子句中的变量,精确模仿离散求解过程。我们识别出局部最优是主要瓶颈,并提出哥德尔技巧——一种随机重参数化方法,以增强解空间探索。进一步揭示该方法与概率推断及Gumbel-Max技巧的正式关联。在SAT基准和视觉数独任务上的实验验证了理论结果,表明该方法能有效穿越复杂组合景观,为可微离散搜索提供坚实基础。
原文摘要 · Abstract (English)
A fundamental challenge in neurosymbolic systems is applying continuous gradient-based optimization to discrete logical domains. While fuzzy relaxations provide differentiability, they often lack a formal structural alignment with classical logic. In this work, we show that Gödel semantics addresses this limitation through a homomorphism that maps its continuous interpretations to Boolean ones, allowing discrete variables to be encoded while maintaining full differentiability. Building on this foundation, we show that gradient-based optimization on Gödel logic instantiates a discrete local search for Boolean satisfiability. Our formal analysis proves that each optimization step identifies and modifies a single variable within a unsatisfied clause, precisely mimicking the steps of a discrete solver. We identify local optima as the primary limitation of such dynamics and introduce the Gödel Trick, a stochastic reparameterization technique designed to improve the exploration of the solution space. We further show a formal connection between this approach, probabilistic inference, and the Gumbel-Max trick. Experimental results on SAT benchmarks and the Visual Sudoku task validate our theoretical findings, demonstrating that our approach effectively navigates complex combinatorial landscapes and provides a solid foundation for differentiable discrete search.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。