提出可验证的通用布尔推理模型,能保证输出为有效电路。
Certifiable Boolean Reasoning Is Universal
- 用概率分布参数化布尔电路,每种参数配置几乎必然生成有效电路。
- 任意布尔函数都能通过调整参数实现,输入维度大时参数线性增长。
- 实测中隐藏单元保持二值性,优于传统MLP的约10%二值率。
智能体系统的兴起使AI的推理能力成为机器学习的核心议题。尽管理论上存在能处理任意布尔任务 $f:{0,1}^B\to{0,1}$ 的神经网络(即模拟扇入2、扇出1的布尔门电路),但训练后的模型屡次无法达到这一理想性能。这引发关键问题:能否设计一个深度学习模型,既能**可验证地始终推理**,又能**普遍地处理任意布尔任务**?同时,该模型在简单任务下应具有少量参数。本文正面回答此问题,提出一种深度学习架构,其参数化布尔电路的概率分布,且对任意参数配置,采样结果几乎必然为有效布尔电路(从而具备内在电路级可验证性)。进一步证明了普适性定理:对任意布尔函数 $f:{0,1}^B\to{0,1}$,总存在参数配置使其以任意高概率正确计算 $f$。当 $f$ 为 $o(log B)$-junta 时,所需参数量随输入维度 $B$ 线性增长。在与设定一致的真值表补全基准测试中,该架构训练稳定,达到高精确匹配准确率,并保持预测结构:所有内部单元在 $\{0,1\}^B$ 上均为布尔值。对比的匹配MLP基线虽达相似准确率,但仅约10%的隐藏单元具有布尔表示(即在布尔立方体上为二值)。
原文摘要 · Abstract (English)
The proliferation of agentic systems has thrust the reasoning capabilities of AI into the forefront of contemporary machine learning. While it is known that there \emph{exist} neural networks which can reason through any Boolean task $f:\{0,1\}^B\to\{0,1\}$, in the sense that they emulate Boolean circuits with fan-in $2$ and fan-out $1$ gates, trained models have been repeatedly demonstrated to fall short of these theoretical ideals. This raises the question: \textit{Can one exhibit a deep learning model which \textbf{certifiably} always reasons and can \textbf{universally} reason through any Boolean task?} Moreover, such a model should ideally require few parameters to solve simple Boolean tasks. We answer this question affirmatively by exhibiting a deep learning architecture which parameterizes distributions over Boolean circuits with the guarantee that, for every parameter configuration, a sample is almost surely a valid Boolean circuit (and hence admits an intrinsic circuit-level certificate). We then prove a universality theorem: for any Boolean $f:\{0,1\}^B\to\{0,1\}$, there exists a parameter configuration under which the sampled circuit computes $f$ with arbitrarily high probability. When $f$ is an $\mathcal{O}(\log B)$-junta, the required number of parameters scales linearly with the input dimension $B$. Empirically, on a controlled truth-table completion benchmark aligned with our setting, the proposed architecture trains reliably and achieves high exact-match accuracy while preserving the predicted structure: every internal unit is Boolean-valued on $\{0,1\}^B$. Matched MLP baselines reach comparable accuracy, but only about $10\%$ of hidden units admit a Boolean representation; i.e.\ are two-valued over the Boolean cube.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。