用AI代理系统自动提取工业日志特征,提升模型性能并减少人工干预。
FELA: A Multi-Agent Evolutionary System for Feature Engineering of Industrial Event Log Data
- 构建多智能体系统,通过思考、编码和评估协作生成新特征。
- 在真实工业数据上显著提升模型表现,且特征可解释性强。
- 适合需要自动化、可解释特征工程的工业场景开发者使用。
事件日志数据记录了细粒度的用户操作与系统事件,是现代数字服务中最宝贵的资产之一。然而,工业事件日志具有规模大、维度高、数据类型多样、时间或关系结构复杂等特点,使得特征工程极具挑战性。现有的自动特征工程方法(如AutoML或遗传算法)往往存在可解释性差、操作预设僵化、对异构数据适应性不足的问题。本文提出FELA(Feature Engineering LLM Agents),一种基于大语言模型(LLMs)的多智能体进化系统,可自主从复杂工业事件日志中提取有意义且高性能的特征。FELA融合了大型语言模型的推理与编程能力,采用“思想-代码-批评”三类专用智能体协同生成、验证与实现新特征。评估智能体汇总反馈,更新分层知识库与双记忆系统,实现持续改进。此外,FELA引入一种智能体演化算法,结合强化学习与遗传算法,平衡探索与利用。在真实工业数据集上的大量实验表明,FELA能生成可解释、领域相关的高质量特征,显著提升模型性能,同时大幅降低人工成本。结果表明,基于LLM的多智能体系统为复杂现实环境中自动化、可解释、自适应的特征工程提供了一种通用范式。
原文摘要 · Abstract (English)
Event log data, recording fine-grained user actions and system events, represent one of the most valuable assets for modern digital services. However, the complexity and heterogeneity of industrial event logs--characterized by large scale, high dimensionality, diverse data types, and intricate temporal or relational structures--make feature engineering extremely challenging. Existing automatic feature engineering approaches, such as AutoML or genetic methods, often suffer from limited explainability, rigid predefined operations, and poor adaptability to complicated heterogeneous data. In this paper, we propose FELA (Feature Engineering LLM Agents), a multi-agent evolutionary system that autonomously extracts meaningful and high-performing features from complex industrial event log data. FELA integrates the reasoning and coding capabilities of large language models (LLMs) with an insight-guided self-evolution paradigm. Specifically, FELA employs specialized agents--Idea Agents, Code Agents, and Critic Agents--to collaboratively generate, validate, and implement novel feature ideas. An Evaluation Agent summarizes feedback and updates a hierarchical knowledge base and dual-memory system to enable continual improvement. Moreover, FELA introduces an agentic evolution algorithm, combining reinforcement learning and genetic algorithm principles to balance exploration and exploitation across the idea space. Extensive experiments on real industrial datasets demonstrate that FELA can generate explainable, domain-relevant features that significantly improve model performance while reducing manual effort. Our results highlight the potential of LLM-based multi-agent systems as a general framework for automated, interpretable, and adaptive feature engineering in complex real-world environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。