用领域知识引导符号回归,让模型更快更准发现物理公式
Parsing the Language of Expression: Enhancing Symbolic Regression with Domain-Aware Symbolic Priors
- 用物理生物等领域的公式统计出符号出现概率,做生成引导
- 新设计的树形RNN结合领域符号先验,提升搜索效率
- 适合需要可解释模型的科研人员,尤其物理化学建模场景
符号回归对揭示数据中隐藏的数学与物理关系至关重要。本文提出一种融合多领域(物理、生物、化学、工程)符号先验的符号回归方法。通过系统分析各领域表达式,构建符号概率分布以指导表达式生成。设计新型树结构循环神经网络,利用这些符号先验引导学习过程。引入分层树结构表示表达式,使一元与二元操作符组织更高效。同时,从各领域提取典型表达式片段并加入操作符字典,提供有效构建块。实验表明,引入符号先验显著提升符号回归性能,实现更快收敛与更高精度。
原文摘要 · Abstract (English)
Symbolic regression is essential for deriving interpretable expressions that elucidate complex phenomena by exposing the underlying mathematical and physical relationships in data. In this paper, we present an advanced symbolic regression method that integrates symbol priors from diverse scientific domains - including physics, biology, chemistry, and engineering - into the regression process. By systematically analyzing domain-specific expressions, we derive probability distributions of symbols to guide expression generation. We propose novel tree-structured recurrent neural networks (RNNs) that leverage these symbol priors, enabling domain knowledge to steer the learning process. Additionally, we introduce a hierarchical tree structure for representing expressions, where unary and binary operators are organized to facilitate more efficient learning. To further accelerate training, we compile characteristic expression blocks from each domain and include them in the operator dictionary, providing relevant building blocks. Experimental results demonstrate that leveraging symbol priors significantly enhances the performance of symbolic regression, resulting in faster convergence and higher accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。