arXiv:2410.03915cs.LG2024-10被引 3

让机器像人一样主动选择获取哪些数据,提升不完整信息下的决策能力。

Distribution Guided Active Feature Acquisition

  • 基于生成模型捕捉特征间依赖关系,动态规划需获取的新数据
  • 在真实场景中实现比现有方法更优的推理准确率与数据获取效率
  • 适合需要成本敏感决策的工业应用,如医疗诊断、智能监控

人类在面对不完整和模糊的数据时,会权衡获取更多信息的成本。而当前多数机器学习研究假设所有特征都已知,无需进一步探查。本文提出一种主动特征获取(AFA)框架,可与环境交互,在特征缺失情况下进行推理,并制定获取新信息的策略。该框架建立在对数据中信息与条件依赖关系的理解基础上:首先构建能捕捉任意特征子集依赖关系的生成模型,并用于贪心式特征选择;其次,利用生成模型提供的辅助信息与奖励信号,指导强化学习代理训练,提升获取效率。此外,还考察了实际部署中的可解释性与鲁棒性问题。大量实验表明,本框架在多个基准上达到当前最优性能。

原文摘要 · Abstract (English)

Human agents routinely reason on instances with incomplete and muddied data (and weigh the cost of obtaining further features). In contrast, much of ML is devoted to the unrealistic, sterile environment where all features are observed and further information on an instance is obviated. Here we extend past static ML and develop an active feature acquisition (AFA) framework that interacts with the environment to obtain new information on-the-fly and can: 1) make inferences on an instance in the face of incomplete features, 2) determine a plan for feature acquisitions to obtain additional information on the instance at hand. We build our AFA framework on a backbone of understanding the information and conditional dependencies that are present in the data. First, we show how to build generative models that can capture dependencies over arbitrary subsets of features and employ these models for acquisitions in a greedy scheme. After, we show that it is possible to guide the training of RL agents for AFA via side-information and auxiliary rewards stemming from our generative models. We also examine two important factors for deploying AFA models in real-world scenarios, namely interpretability and robustness. Extensive experiments demonstrate the state-of-the-art performance of our AFA framework.

主动学习特征选择生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。