arXiv:2608.25291cs.LGcs.AI2026-08

用大模型引导符号回归,让搜索更准更快。

InsightSR: Refining Symbolic Regression Search Spaces via Parallel Semantic and Structural LLM Guidance

论文配图:InsightSR: Refining Symbolic Regression Search Spaces via Parallel Semantic and Structural LLM Guidance
图 1 · 摘自论文原文
  • 用大模型分两路优化搜索空间:语义骨架和非线性特征变换。
  • 在费曼基准上实现95%精确恢复,在真实数据上保持强泛化能力。
  • 适合做物理定律发现、自动化建模的研究者和工程师。

符号回归(SR)旨在从观测数据中发现简洁的数学规律,但传统方法常受限于物理意义表达式的巨大组合搜索空间。我们提出InsightSR框架,将大语言模型(LLMs)作为指导层嵌入到PySR遗传编程引擎周围。不直接由LLM生成表达式,而是利用其通过两条互补路径逐步重构搜索空间:语义种子路径提出量纲一致的功能骨架,结构特征路径推荐非线性特征变换。这些变换在迭代中累积,拓展输入空间,使符号搜索从原始变量构建深层表达式树,转变为在丰富语义特征集上组装浅层树。生成后引入反馈回路,评估候选解,按经验效用分类特征,并优化下一迭代的指导策略,将发现过程转化为迭代自修正的精炼流程。在三个基准测试中,InsightSR在费曼基准上实现95%精确恢复率,在LLM-SRBench LSR-Transform任务上达到80.18%准确率,显著优于当前顶尖的遗传编程与神经符号方法,同时在真实世界数据集上保持优异的分布外泛化能力。

原文摘要 · Abstract (English)

Symbolic regression (SR) seeks to discover parsimonious mathematical laws from observational data, yet conventional approaches often struggle with the vast combinatorial search space of physically meaningful expressions. We present InsightSR, a framework that embeds Large Language Models (LLMs) as a guiding layer around the PySR genetic programming engine. Rather than relying on LLMs to generate expressions directly, InsightSR uses LLMs to progressively transform the search space itself through two complementary pathways: a Semantic Seed Pathway that proposes dimensionally consistent functional skeletons, and a Structural Feature Pathway that recommends nonlinear feature transformations. These transformations accumulate over iterations, broadening the input space and shifting the symbolic search from constructing deep expression trees over raw variables to assembling shallow trees over a rich, semantically informed feature set. A post-generation feedback loop evaluates candidates, categorizes features by their empirical utility, and refines the guidance for the next iteration, transforming the discovery process from open-ended generation into iterative, self-correcting refinement. Across three benchmarks, InsightSR achieves a 95% exact recovery rate on the Feynman benchmark and 80.18% accuracy on the LLM-SRBench LSR-Transform task, substantially outperforming state-of-the-art genetic programming and neural-symbolic methods while maintaining strong out-of-distribution generalization on real-world datasets.

符号回归大模型遗传编程自动建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。