用因果引导强化学习自动构建更鲁棒的特征表示
Causally-Guided Automated Feature Engineering with Multi-Agent Reinforcement Learning
- 将特征工程建模为因果引导的序列决策问题,分两阶段进行
- 在15个公开数据集上提升7%性能,且抗分布偏移能力增强4倍
- 适合关注模型鲁棒性与自动化特征构造的研究者
自动化特征工程(AFE)使AI系统能从原始表格数据中自主构建高价值表示。然而现有方法依赖统计启发式,导致特征在分布偏移下表现脆弱。本文提出CAFE框架,将AFE重构为因果引导的序贯决策过程,融合因果发现与强化学习驱动的特征构造。第一阶段通过稀疏有向无环图学习特征与目标间的软因果先验,将特征分为直接、间接和其他三类。第二阶段采用级联多智能体深度Q学习架构,选择因果组与变换算子,结合层级奖励设计与因果组级探索策略,优先生成因果合理的变换并控制特征复杂度。在15个公开基准上(分类以宏平均F1衡量;回归以逆相对绝对误差衡量),CAFE相比强基线最高提升7%,收敛速度更快,达到竞争力的时间-目标表现。在受控协变量偏移下,相较非因果多智能体基线,性能下降减少约4倍,生成更紧凑的特征集且后验归因更稳定。结果表明,将因果结构作为软归纳先验而非刚性约束,可显著提升自动化特征工程的鲁棒性与效率。
原文摘要 · Abstract (English)
Automated feature engineering (AFE) enables AI systems to autonomously construct high-utility representations from raw tabular data. However, existing AFE methods rely on statistical heuristics, yielding brittle features that fail under distribution shift. We introduce CAFE, a framework that reformulates AFE as a causally-guided sequential decision process, bridging causal discovery with reinforcement learning-driven feature construction. Phase I learns a sparse directed acyclic graph over features and the target to obtain soft causal priors, grouping features as direct, indirect, or other based on their causal influence with respect to the target. Phase II uses a cascading multi-agent deep Q-learning architecture to select causal groups and transformation operators, with hierarchical reward shaping and causal group-level exploration strategies that favor causally plausible transformations while controlling feature complexity. Across 15 public benchmarks (classification with macro-F1; regression with inverse relative absolute error), CAFE achieves up to 7% improvement over strong AFE baselines, reduces episodes-to-convergence, and delivers competitive time-to-target. Under controlled covariate shifts, CAFE reduces performance drop by ~4x relative to a non-causal multi-agent baseline, and produces more compact feature sets with more stable post-hoc attributions. These findings underscore that causal structure, used as a soft inductive prior rather than a rigid constraint, can substantially improve the robustness and efficiency of automated feature engineering.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。