arXiv:2503.11991cs.LG2025-03被引 3

用强化学习自动选特征,提升模型效率与准确性

Automation and Feature Selection Enhancement with Reinforcement Learning (RL)

  • 用单/双智能体强化学习动态选择最优特征子集
  • 引入早期停止和奖励交互策略,降低计算开销
  • 适合高维数据场景,可解释性强,适用于自动化建模

有效的特征选择、表示与变换是提升机器学习预测精度、模型泛化能力和计算效率的关键步骤。强化学习为平衡探索最优特征子集提供了新视角,采用单智能体与多智能体模型。结合决策树的交互式强化学习提升了特征知识、状态表示与选择效率,多样化教学策略进一步优化了选择质量与效率。通过沿特征序列扫描并使用卷积自编码器,可增强状态表示。基于蒙特卡洛的强化特征选择(MCRFS)通过早期停止和奖励级交互策略降低计算负担。还提出双智能体强化学习框架,协同选择特征与样本,捕捉其相互作用,使智能体能有效导航复杂数据空间。通过级联强化智能体迭代优化特征空间,形成自优化框架。强化学习、多智能体系统与基于贝叶斯的探索方法相结合,为处理高维数据和挑战性预测任务提供了可扩展且可解释的机器学习新路径。

原文摘要 · Abstract (English)

Effective feature selection, representation and transformation are principal steps in machine learning to improve prediction accuracy, model generalization and computational efficiency. Reinforcement learning provides a new perspective towards balanced exploration of optimal feature subset using multi-agent and single-agent models. Interactive reinforcement learning integrated with decision tree improves feature knowledge, state representation and selection efficiency, while diversified teaching strategies improve both selection quality and efficiency. The state representation can further be enhanced by scanning features sequentially along with the usage of convolutional auto-encoder. Monte Carlo-based reinforced feature selection(MCRFS), a single-agent feature selection method reduces computational burden by incorporating early-stopping and reward-level interactive strategies. A dual-agent RL framework is also introduced that collectively selects features and instances, capturing the interactions between them. This enables the agents to navigate through complex data spaces. To outperform the traditional feature engineering, cascading reinforced agents are used to iteratively improve the feature space, which is a self-optimizing framework. The blend of reinforcement learning, multi-agent systems, and bandit-based approaches offers exciting paths for studying scalable and interpretable machine learning solutions to handle high-dimensional data and challenging predictive tasks.

强化学习特征选择自动化建模多智能体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。