用AI自动生成可执行代码特征,提升企业资源预测效果
Eureka: Intelligent Feature Engineering for Enterprise AI Cloud Resource Demand Prediction

- 将特征工程视为可生成、评估、迭代的代码生成任务
- 在7个公开数据集上超越传统与LLM基线方法,云资源预测准确率提升16%
- 适合需要自动化特征设计的企业级AI系统研发人员
有效特征对预测模型性能至关重要,但传统特征工程依赖领域知识,难以跨场景扩展。本文将特征工程定义为智能体驱动的代码生成问题:特征不是静态的数据变换,而是可执行的程序。提出Eureka框架,包含三个阶段:(1) 经过领域知识微调的专家智能体生成结构化的特征设计计划(JSON格式);(2) LLM特征工厂通过思维链推理,将计划转化为可运行的Python代码;(3) 自进化对齐引擎采用双通道奖励机制(指标效用+语义一致性)结合强化学习(GRPO),持续优化代码质量。通过将特征表达为程序,学习到的生成模式可跨领域迁移。在医疗、金融、社交领域的7个公开基准上,Eureka始终优于传统AutoFE及基于LLM的基线方法。进一步在阿里云实际场景中验证,其在GPU资源需求预测中使需求满足率提升16%,计算资源迁移率降低33%。
原文摘要 · Abstract (English)
Effective features are crucial for predictive model performance, but creating them often requires domain expertise, limiting scalability across applications. We define feature engineering as an agentic code generation problem: features are not static data transformations, but executable programs that can be generated, evaluated, and iteratively improved. We present Eureka, an LLM-driven framework with three stages. (1) An Expert Agent, fine-tuned via SFT on domain knowledge, produces structured feature design plans in JSON format. (2) An LLM Feature Factory translates each plan into executable Python code through chain-of-thought reasoning, turning feature hypotheses into runnable programs. (3) A Self-Evolving Alignment Engine uses Reinforcement Learning (GRPO) with dual-channel reward (metric-based utility + semantic alignment) to enhance code quality. By expressing features as programs, the learned generation patterns can transfer across domains. Evaluated on 7 public benchmarks in healthcare, finance, and social domains, Eureka consistently outperforms both traditional AutoFE and LLM-based baselines. We further demonstrate Eureka's effectiveness on cloud GPU resource demand prediction at Alibaba Cloud, where Eureka improves demand fulfillment rate by 16% and lowers computing resource migration rates by 33%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。