让机器自动演化计算图结构,解决传统模型难以处理的复杂推理问题。
EvoForest: A Novel Machine-Learning Paradigm via Open-Ended Evolution of Computational Graphs

- 通过可进化计算图联合优化结构、函数和参数,实现端到端自动设计计算流程。
- 在结构断裂挑战赛中达到94.13% ROC-AUC,超越公开最优成绩90.14%。
- 适合需要可解释性、非可微目标或持续适应的任务场景。
现代机器学习仍主要依赖固定模型家族并优化参数,但面对结构化预测任务时,瓶颈常在于确定应从数据中计算什么,而非调整参数。成功取决于识别正确的变换、统计量、不变性、交互结构、时间摘要、门控机制或非线性组合,尤其当目标不可微、评估基于交叉验证、需可解释性或持续适应时。本文提出EvoForest,一种混合神经符号系统,支持计算过程的端到端开放式演化。它不只生成特征,而是共同演化可重用的计算结构、可调用函数族及低维连续组件,嵌入共享有向无环图中。中间节点存储替代实现,可调用节点编码如投影、门控、激活等可复用变换族,输出节点定义候选预测计算,全局持久参数可通过梯度下降优化。每个图配置经评估后,使用轻量级岭回归读出对非可微交叉验证目标的评分,并生成结构化反馈以指导后续大语言模型驱动的突变。在2025 ADIA Lab结构断裂挑战赛中,EvoForest经600次演化步骤达94.13% ROC-AUC,超过公开报告的最优分90.14%,且评估协议一致。
原文摘要 · Abstract (English)
Modern machine learning is still largely organized around a single recipe: choose a parameterized model family and optimize its weights. Although highly successful, this paradigm is too narrow for many structured prediction problems, where the main bottleneck is not parameter fitting but discovering what should be computed from the data. Success often depends on identifying the right transformations, statistics, invariances, interaction structures, temporal summaries, gates, or nonlinear compositions, especially when objectives are non-differentiable, evaluation is cross-validation-based, interpretability matters, or continual adaptation is required. We present EvoForest, a hybrid neuro-symbolic system for end-to-end open-ended evolution of computation. Rather than merely generating features, EvoForest jointly evolves reusable computational structure, callable function families, and trainable low-dimensional continuous components inside a shared directed acyclic graph. Intermediate nodes store alternative implementations, callable nodes encode reusable transformation families such as projections, gates, and activations, output nodes define candidate predictive computations, and persistent global parameters can be refined by gradient descent. For each graph configuration, EvoForest evaluates the discovered computation and uses a lightweight Ridge-based readout to score the resulting representation against a non-differentiable cross-validation target. The evaluator also produces structured feedback that guides future LLM-driven mutations. In the 2025 ADIA Lab Structural Break Challenge, EvoForest reached 94.13% ROC-AUC after 600 evolution steps, exceeding the publicly reported winning score of 90.14% under the same evaluation protocol.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。