arXiv:2507.13712cs.DBcs.LG2025-07被引 1

用大模型指导自动数据预处理,提速降耗还更准。

LLaPipe: LLM-Guided Reinforcement Learning for Automated Data Preparation Pipeline Construction

  • 用大模型分析数据语义和历史记录,智能推荐预处理操作。
  • 在18个数据集上提升22.4%管道质量,速度加快2.3倍。
  • 按需调用大模型,平均仅用19%的探索步骤,高效省力。

自动化数据准备对普及机器学习至关重要,但现有基于强化学习的方法在庞大预处理管道空间中探索效率低下。本文提出LLaPipe框架,通过引入大语言模型(LLM)作为智能策略顾问,解决探索瓶颈。该框架包含三项创新:(1) LLM策略顾问,分析数据语义与管道历史,推荐有前景的操作;(2) 经验蒸馏机制,挖掘过往成功模式并迁移用于引导探索;(3) 自适应顾问触发策略(Advisor⁺),动态判断何时启用LLM干预,平衡效果与计算开销。在18个跨领域数据集上的实验表明,LLaPipe相比顶尖强化学习方法,管道质量最高提升22.4%,收敛速度提高2.3倍,同时通过选择性使用LLM,平均仅占总探索步骤的19.0%,保持高效。

原文摘要 · Abstract (English)

Automated data preparation is crucial for democratizing machine learning, yet existing reinforcement learning (RL) based approaches suffer from inefficient exploration in the vast space of possible preprocessing pipelines. We present LLaPipe, a novel framework that addresses this exploration bottleneck by integrating Large Language Models (LLMs) as intelligent policy advisors. Unlike traditional methods that rely solely on statistical features and blind trial-and-error, LLaPipe leverages the semantic understanding capabilities of LLMs to provide contextually relevant exploration guidance. Our framework introduces three key innovations: (1) an LLM Policy Advisor that analyzes dataset semantics and pipeline history to suggest promising preprocessing operations, (2) an Experience Distillation mechanism that mines successful patterns from past pipelines and transfers this knowledge to guide future exploration, and (3) an Adaptive Advisor Triggering strategy (Advisor\textsuperscript{+}) that dynamically determines when LLM intervention is most beneficial, balancing exploration effectiveness with computational cost. Through extensive experiments on 18 diverse datasets spanning multiple domains, we demonstrate that LLaPipe achieves up to 22.4\% improvement in pipeline quality and 2.3$\times$ faster convergence compared to state-of-the-art RL-based methods, while maintaining computational efficiency through selective LLM usage (averaging only 19.0\% of total exploration steps).

自动化数据大模型强化学习管道优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。