arXiv:2603.15110cs.LGcs.CV2026-03

动态推荐最优特征组合,兼顾模型性能与采集成本。

Sampling-guided exploration of active feature selection policies

  • 基于强化学习逐轮推荐最值得采集的特征,避免数据补全。
  • 在56特征数据集上准确率超越现有方法,且策略更简洁。
  • 适合高成本特征采集场景,如生物医学、遥感分析。

确定机器学习预测模型的最佳特征面临性能与特征获取成本的双重挑战。尤其当某些特征仅对部分样本有益时,全局特征选择受限。此前工作提出一种强化学习方法,根据已获取的实例特异性信息,顺序推荐下一要采集的模态,以实现最佳信息/成本比,并将问题建模为状态维度可变的马尔可夫决策过程,避免了数据插补。但该方法仅适用于少量特征,因需考虑所有可能的特征组合。本文提出两项改进:1)引入启发式策略,聚焦最有前景的特征组合,扩展至更大数据集;2)引入后拟合正则化策略,减少不同特征组合数量,生成更紧凑的决策序列。在四个二分类数据集(含一个高维变量数据集)上测试,最大数据集包含56个特征和4500个样本,结果优于当前最优方法,在准确率和策略复杂度上均表现更优。

原文摘要 · Abstract (English)

Determining the most appropriate features for machine learning predictive models is challenging regarding performance and feature acquisition costs. In particular, global feature choice is limited given that some features will only benefit a subset of instances. In previous work, we proposed a reinforcement learning approach to sequentially recommend which modality to acquire next to reach the best information/cost ratio, based on the instance-specific information already acquired. We formulated the problem as a Markov Decision Process where the state's dimensionality changes during the episode, avoiding data imputation, contrary to existing works. However, this only allowed processing a small number of features, as all possible combinations of features were considered. Here, we address these limitations with two contributions: 1) we expand our framework to larger datasets with a heuristic-based strategy that focuses on the most promising feature combinations, and 2) we introduce a post-fit regularisation strategy that reduces the number of different feature combinations, leading to compact sequences of decisions. We tested our method on four binary classification datasets (one involving high-dimensional variables), the largest of which had 56 features and 4500 samples. We obtained better performance than state-of-the-art methods, both in terms of accuracy and policy complexity.

特征选择强化学习高效采集决策优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。