用数学模型揭示智能系统如何通过组合可靠解法解决难题。
Odds Law: The Decomposition Algebra On How Intelligence Organizes Itself to Solve Difficult Problems Reliably
- 构建分解代数,用四种组合方式生成复杂求解器。
- 验证门可几何级放大正确率,实现对高可靠性目标的高效达成。
- 证明独立信息与多样化是无限提升可靠性的必要条件。
我们提出一个结构性问题:在基础求解器不可靠的前提下,什么样的组织形式能稳定解决复杂问题?为此,我们建立了一套分解代数——将基础求解器视为随机范畴中的态射,通过串行组合、并行集成、验证门控和递归简化四种组合器,生成复合求解器。我们引入两个同态映射:可靠性估值(取值于[0,1]有序幺半群)和成本估值(取值于交换半环),推导出可靠性在结构中传播的组合规律。核心结果包括:(i) 验证几率定律,即验证门使正确性几率乘以验证器似然比Λ,k个条件独立门带来几何级放大;(ii) 可靠性放大定理,当Λ>1时,仅需O(log 1/δ)层验证即可达到目标可靠性1-δ;(iii) 阈值二分性:超过临界参数时可靠性可趋近1且成本对数增长,否则无法放大。进一步证明自组织是单调优化算子在策略完备格上的最小不动点,其均衡边际对数几率增益/单位成本。最后给出匹配极限:信息上限限制单门放大程度;共享错误导致投票下限为正,故多样性对无界放大至关重要。可靠性既非免费也非魔术,而是依赖独立信息、经由组合结构、受验证者约束而获得。
原文摘要 · Abstract (English)
We ask a structural question: given unreliable elementary problem-solvers, what organizations of them solve hard problems reliably, and what are the limits? We develop a $decomposition~algebra$: elementary solvers are morphisms in a stochastic category, and four combinators (sequential composition, parallel ensembling, verification gating, and recursive reduction) generate the space of compound solvers. We equip this algebra with two homomorphisms, a $reliability$ valuation into the ordered monoid $([0,1],\le)$ and a $cost$ valuation into a commutative semiring, and we derive the composition laws that govern how reliability flows through structure. Our central results are (i) a $verification~odds~law$ (the result that names this report), showing that a verification gate multiplies the odds of correctness by the verifier's likelihood ratio $Λ$, so that $k$ conditionally independent gates yield geometric amplification; (ii) a $reliability~amplification~theorem$, giving target reliability $1-δ$ at $O(\log 1/δ)$ verification depth whenever $Λ>1$; and (iii) a $threshold~dichotomy$: above the critical parameters reliability can be driven arbitrarily close to one at logarithmic cost, while at or below them no amplification is possible. We then show that $self-organization$ is the least fixed point of a monotone improvement operator on the complete lattice of strategies, and that this fixed point equalizes marginal log-odds gain per unit cost. Finally, we prove matching limits: an information ceiling bounds per-gate amplification by a divergence quantity; shared error causes create a strictly positive voting floor, so diversity is $necessary$ for unbounded amplification. Reliability, in short, is neither free nor magical: it is bought with independent information, arranged by composition, and bounded by the verifier.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。