用生成空间重构方程搜索,让符号回归更准更快。
GENSR: Symbolic Regression Based in Equation Generative Space
- 构建连续可微的方程生成潜空间,使结构变化平滑
- 在噪声数据下仍保持高精度与表达式简洁性
- 适合需要高效找物理规律的研究者
符号回归试图从观测数据中揭示隐藏的数学方程。然而,现有方法多在离散方程空间中搜索,方程结构变化与数值行为不一致,导致拟合误差反馈过噪,难以引导探索。为此,我们提出GenSR,一种基于生成潜空间的符号回归框架,遵循‘地图构建→粗定位→精搜’范式。首先,预训练双分支条件变分自编码器(CVAE),将符号方程重参数化为具有符号连续性和局部数值平滑性的生成潜空间,该空间可视为方程空间的有序地图,提供搜索方向信号。推理时,CVAE将输入数据粗略定位至潜空间中的潜在区域,随后使用改进的CMA-ES在此区域精炼候选解,利用平滑潜空间梯度。从贝叶斯视角看,GenSR将符号回归任务重新建模为最大化条件分布 $p(\mathrm{Equ.} \mid \mathrm{Num.})$,CVAE通过证据下界(ELBO)实现此目标,提供理论保证。大量实验表明,GenSR在预测精度、表达式简洁性与计算效率上协同优化,且对噪声具有鲁棒性。
原文摘要 · Abstract (English)
Symbolic Regression (SR) tries to reveal the hidden equations behind observed data. However, most methods search within a discrete equation space, where the structural modifications of equations rarely align with their numerical behavior, leaving fitting error feedback too noisy to guide exploration. To address this challenge, we propose GenSR, a generative latent space-based SR framework following the `map construction -> coarse localization -> fine search'' paradigm. Specifically, GenSR first pretrains a dual-branch Conditional Variational Autoencoder (CVAE) to reparameterize symbolic equations into a generative latent space with symbolic continuity and local numerical smoothness. This space can be regarded as a well-structured `map'' of the equation space, providing directional signals for search. At inference, the CVAE coarsely localizes the input data to promising regions in the latent space. Then, a modified CMA-ES refines the candidate region, leveraging smooth latent gradients. From a Bayesian perspective, GenSR reframes the SR task as maximizing the conditional distribution $p(\mathrm{Equ.} \mid \mathrm{Num.})$, with CVAE training achieving this objective through the Evidence Lower Bound (ELBO). This new perspective provides a theoretical guarantee for the effectiveness of GenSR. Extensive experiments show that GenSR jointly optimizes predictive accuracy, expression simplicity, and computational efficiency, while remaining robust under noise.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。