首次用统一框架解析特征获取的智能决策方法
A Survey on Active Feature Acquisition Strategies
- 将特征获取建模为部分可观测马尔可夫决策过程
- 系统梳理四类主流方法并建立分类体系
- 适合研究高效机器学习决策与优化的学者
主动特征获取(AFA)研究如何在预测性能与获取成本之间权衡,逐个获取数据实例的特征。本文首次通过显式的部分可观测马尔可夫决策过程(POMDP)框架对AFA进行统一建模。该框架置于最优信息获取的更广泛文献中,并与一类结构化POMDP(如信息收集和感知POMDP)相联系,其假设与算法工具可直接应用于AFA。这一连接为比较不同问题设置与方法提供了共同语言,并揭示了AFA可借鉴结构化POMDP规划与近似中的已有成果。基于此视角,本文提出一个最新的AFA方法分类体系,大致对应求解POMDP的标准方法:(i) 嵌入成本感知的预测器(如代价敏感决策树与集成模型),(ii) 使用学习到的概率组件进行规划的模型方法,(iii) 从模拟经验中学习获取策略的无模型方法,(iv) 融合模型与无模型优势的混合方法。本文认为,以POMDP为中心的视角澄清了现有方法间的关联,并推动更严谨的算法设计。由于大量前期工作依赖启发式且缺乏形式化保证,本文还探讨了通过连接自适应随机优化来获得理论保障的路径。最后,指出了开放挑战与未来研究方向。
原文摘要 · Abstract (English)
Active feature acquisition (AFA) studies how to sequentially acquire features for each data instance to trade off predictive performance against acquisition cost. This survey offers the first unified treatment of AFA via an explicit partially observable Markov decision process (POMDP) formulation. We place this formulation in the broader literature on optimal information acquisition and, more specifically, in a family of structured POMDPs (for example, information-gathering and sensing POMDPs) whose assumptions and algorithmic tools directly apply to AFA. This connection provides a common language for comparing problem settings and methods, and it highlights where AFA can leverage established results in structured POMDP planning and approximation. Building on this perspective, we present an up-to-date taxonomy of AFA methods that (roughly) mirrors standard approaches to solving POMDPs: (i) embedded cost-aware predictors (notably cost-sensitive decision trees and ensembles), (ii) model-based methods that plan using learned probabilistic components, (iii) model-free methods that learn acquisition policies from simulated episodes, and (iv) hybrid methods that combine the strengths of model-based and model-free approaches. We argue that this POMDP-centric view clarifies connections among existing methods and motivates more principled algorithm design. Since much prior work is heuristic and lacks formal guarantees, we also outline routes to guarantees by connecting AFA to adaptive stochastic optimization. We conclude by highlighting open challenges and promising directions for future research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。