将基因编程的表达式演化与学习解耦,提升泛化能力
Decoupling Representation and Learning in Genetic Programming: the LaSER Approach
- 用外部学习器替代传统适应度评估,分离表达式演化与性能学习
- 在复杂数据集上,非线性学习器使LaSER优于传统GP和线性回归
- 支持进化学习中的贝朗效应,适合符号回归与分类任务
基因编程(GP)长期将符号表达式的演化与基于性能的评估紧密耦合,通常仅依赖原始适应度分数。这种紧耦合使GP解更脆弱且易过拟合,削弱其泛化能力。本文提出LaSER(潜在语义表示回归)——一种将表达式演化与终身学习解耦的通用框架。每代中,候选程序生成特征,交由外部学习器建模目标任务。该方法可任选函数逼近器(从线性模型到神经网络)作为终身学习器,实现超越传统符号形式的表达能力。首次证明,当使用非线性方法拟合GP生成方程系数时,LaSER在复杂数据集上优于标准GP及后续线性回归。此外,探索发现LaSER可促进内生表示的涌现,支持进化学习中长期存在的贝朗效应。通过分离表达式与适应角色,LaSER为符号回归与分类提供了原理清晰且可扩展的框架。
原文摘要 · Abstract (English)
Genetic Programming (GP) has traditionally entangled the evolution of symbolic representations with their performance-based evaluation, often relying solely on raw fitness scores. This tight coupling makes GP solutions more fragile and prone to overfitting, reducing their ability to generalize. In this work, we propose LaSER (Latent Semantic Representation Regression)} -- a general framework that decouples representation evolution from lifetime learning. At each generation, candidate programs produce features which are passed to an external learner to model the target task. This approach enables any function approximator, from linear models to neural networks, to serve as a lifetime learner, allowing expressive modeling beyond conventional symbolic forms. Here we show for the first time that LaSER can outcompete standard GP and GP followed by linear regression when it employs non-linear methods to fit coefficients to GP-generated equations against complex data sets. Further, we explore how LaSER enables the emergence of innate representations, supporting long-standing hypotheses in evolutionary learning such as the Baldwin Effect. By separating the roles of representation and adaptation, LaSER offers a principled and extensible framework for symbolic regression and classification.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。