arXiv:2505.15076cs.LGcs.AI2025-05被引 12

用智能代理统一处理特征选择与生成,提升模型性能

Agentic Feature Augmentation: Unifying Selection and Generation with Teaming, Planning, and Memories

  • 设计多智能体系统,分工协作完成特征筛选与生成
  • 在多个数据集上表现优于传统方法,显著提升任务精度
  • 适合需要自动化特征工程的科研与工业场景

特征工程是提升人工智能模型性能的重要手段,但现有方法通常将特征选择与生成分开处理,难以平衡冗余消除与信息增益。为此,本文提出一种基于智能体的特征增强框架,将特征生成与选择统一建模为智能体协作与规划过程。构建包含选择器、生成器和路由器三类智能体的MAGS系统:选择器剔除冗余特征,生成器创建新维度,路由器通过短期记忆进行即时反馈优化,长期记忆提供全局策略指导。利用离线近端策略优化(PPO)对路由器进行强化学习微调,以高效探索离散特征空间。大量实验表明,该统一框架能智能协调特征处理流程,在多个基准数据集上持续取得更优性能。

原文摘要 · Abstract (English)

As a widely-used and practical tool, feature engineering transforms raw data into discriminative features to advance AI model performance. However, existing methods usually apply feature selection and generation separately, failing to strive a balance between reducing redundancy and adding meaningful dimensions. To fill this gap, we propose an agentic feature augmentation concept, where the unification of feature generation and selection is modeled as agentic teaming and planning. Specifically, we develop a Multi-Agent System with Long and Short-Term Memory (MAGS), comprising a selector agent to eliminate redundant features, a generator agent to produce informative new dimensions, and a router agent that strategically coordinates their actions. We leverage in-context learning with short-term memory for immediate feedback refinement and long-term memory for globally optimal guidance. Additionally, we employ offline Proximal Policy Optimization (PPO) reinforcement fine-tuning to train the router agent for effective decision-making to navigate a vast discrete feature space. Extensive experiments demonstrate that this unified agentic framework consistently achieves superior task performance by intelligently orchestrating feature selection and generation.

特征工程多智能体强化学习自动化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。