arXiv:2609.04639cs.LG2026-09

SMILE通过三阶段融合连续优化与符号恢复,高效发现噪声数据中的简洁数学表达式。

SMILE: Bridging Continuous Optimization and Discrete Symbolic Recovery

  • 分三步:先分析数据结构,再用可解释激活函数做连续优化,最后通过剪枝和取整提取符号表达式
  • 在高噪声下仍保持最高符号解率,且比竞品快数倍、表达式更简洁
  • 适合需要可解释性数学模型的科研与工程场景,尤其对复杂数据结构敏感

符号回归(SR)从数据中发现闭合形式的数学表达式,提供黑箱模型无法比拟的可解释性。现有方法在组合搜索空间中收敛缓慢,且缺乏利用数据中复合结构的机制。我们提出SMILE(正弦、乘法、恒等、对数、指数),一种混合框架,通过三个阶段统一连续梯度优化与离散符号恢复:首先分析数据以识别目标表达式的组合层次结构;其次使用可解释激活函数的神经网络进行连续参数优化;最后通过结构化剪枝、系数优化与取整,将学习到的网络提炼为包含精确符号常数的紧凑表达式。我们在SRBench上评估了SMILE在真实表达式与黑盒数据集上的表现,并通过消融实验验证各组件有效性。SMILE在最大噪声水平下达到最高符号解率,展现出强鲁棒性,而竞争方法在此条件下显著退化。它始终位于准确率与复杂度的帕累托前沿,以远少于竞争方法的时间恢复出明显更简单的表达式。

原文摘要 · Abstract (English)

Symbolic regression (SR) discovers closed-form mathematical expressions from data, offering interpretability beyond black-box models. Existing methods suffer from slow convergence in combinatorial search spaces and lack mechanisms to exploit compositional structure in the data. We introduce SMILE (Sine, Multiplication, Identity, Logarithm, Exponential), a hybrid framework that unifies continuous gradient-based optimization with discrete symbolic recovery through three stages: structural analysis of the data to identify the compositional hierarchy of the target expression, continuous optimization to learn parameters of a network that encodes the target expression using interpretable activations, and symbolic recovery through structured pruning, coefficient optimization, and rounding. This final stage distills the learned network into a compact expression with exact symbolic constants. We evaluate SMILE on SRBench across ground-truth and black-box datasets, with ablation studies validating each component. SMILE achieves the highest symbolic solution rate at the largest noise levels, demonstrating strong robustness where competing methods degrade substantially. It consistently lies on the Pareto front of accuracy versus complexity, recovering significantly simpler expressions in a fraction of the time required by the competing methods.

符号回归可解释模型数学表达式发现

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。