arXiv:2506.17940cs.LGcs.AI2025-06被引 4

提出一种更低成本、更可信的新型人工智能学习框架。

An entropy-optimal path to humble AI

  • 基于熵优化与精确概率定律,构建无需梯度下降的新学习机制。
  • 模型性能接近顶尖水平,参数量逼近问题内在复杂度下限。
  • 适合追求高效、可靠且资源消耗低的AI应用者使用。

人工智能发展带来了高性能但代价高昂、过度自信的模型与工具,尤其体现在(i)所需成本和资源持续飙升,以及(ii)输出结果的过度自信。本文提出一种基于精确全概率定律与凸多面体表示的非平衡熵优化玻尔兹曼机重构框架。该方法实现高性能、低成本的无梯度学习,具备数学上可证明的存在性与唯一性,同时能廉价计算输入与输出的置信度/可靠性指标。在多种合成与真实世界问题上,与先进AI工具对比显示,该方法生成的模型性能更优且更紧凑,其模型描述长度接近底层问题的内在复杂度理论下界。应用于历史气候数据时,可仅用数年数据训练,显著提升对拉尼娜与厄尔尼诺现象发生时机的预测能力,远少于现有气候预测工具所需的数据量。

原文摘要 · Abstract (English)

Progress of AI has led to very successful, but by no means humble models and tools, especially regarding (i) the huge and further exploding costs and resources they demand, and (ii) the over-confidence of these tools with the answers they provide. Here we introduce a novel mathematical framework for a non-equilibrium entropy-optimizing reformulation of Boltzmann machines based on the exact law of total probability and the exact convex polytope representations. We show that it results in the highly-performant, but much cheaper, gradient-descent-free learning framework with mathematically-justified existence and uniqueness criteria, and cheaply-computable confidence/reliability measures for both the model inputs and the outputs. Comparisons to state-of-the-art AI tools in terms of performance, cost and the model descriptor lengths on a broad set of synthetic and real-world problems with varying complexity reveal that the proposed method results in more performant and slim models, with the descriptor lengths being very close to the intrinsic complexity scaling bounds for the underlying problems. Applying this framework to historical climate data results in models with systematically higher prediction skills for the onsets of important La Niña and El Niño climate phenomena, requiring just few years of climate data for training - a small fraction of what is necessary for contemporary climate prediction tools.

AI效率熵优化可信推理低资源学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。