arXiv:2606.24679cs.LGcs.AI2026-06中稿 · SIGMOD 2027

用流模型+大模型引导,自动构建更高效的数据清洗流程。

FlowPipe: LLM-Enhanced Conditional Generative Flow Networks for Data Preparation Pipeline Construction

论文配图:FlowPipe: LLM-Enhanced Conditional Generative Flow Networks for Data Preparation Pipeline Construction
图 1 · 摘自论文原文
  • 将数据管道生成建模为条件概率流,通过轨迹平衡连接早期决策与最终奖励。
  • 在74个真实数据集上平均提升准确率11.96%,训练速度加快12.5倍。
  • 结合大模型语义先验与失败感知机制,适合自动化数据预处理场景。

数据准备流水线通过一系列清洗与特征转换操作,将原始表格转化为可学习数据,从而提升机器学习的数据质量。然而,自动构建此类流水线计算成本高,因操作序列具有组合性且端到端评估代价大。现有最先进(SOTA)的多级DQN方法仍存在三大局限:价值估计器解耦导致长程信用分配弱化,数据集上下文仅被弱注入策略,且在大量无效状态的稀疏搜索空间中探索效率低。为此,我们提出FlowPipe,一个统一框架,将流水线合成建模为有向无环图上的条件概率流生成。FlowPipe采用条件生成流网络(C-GFlowNets)并引入轨迹平衡目标,将终端验证奖励与早期流水线决策相连。进一步通过特征逐维线性调制(FiLM)实现深度语义调制,使大模型生成的逻辑先验能根据数据语义调节策略内部激活。此外,FlowPipe在流目标中融入失败感知机制,避免无效状态,集中搜索于高潜力区域。在包含74个真实数据集的两个基准套件上的实验表明,FlowPipe优于现有最先进基线,平均准确率提升11.96%,训练收敛速度提高12.5倍。源代码见 https://github.com/KunyuNi/FlowPipe。

原文摘要 · Abstract (English)

Data preparation pipelines improve data quality in machine learning by transforming raw tables into learning-ready data through sequential cleaning and feature transformation operators. However, automatically constructing such pipelines is computationally difficult because operator sequences are combinatorial and end-to-end evaluation is expensive. Existing state-of-the-art (SOTA) Multi-DQN methods still face three key limitations: decoupled value estimators weaken long-horizon credit assignment, dataset context is only weakly injected into the policy, and exploration is inefficient in a sparse search space with many invalid states. To address these issues, we propose FlowPipe, a unified framework that formulates pipeline synthesis as conditional probabilistic flow generation over a directed acyclic graph. FlowPipe uses Conditional Generative Flow Networks (C-GFlowNets) with a Trajectory Balance objective to connect terminal validation rewards with early pipeline decisions. It further introduces Deep Semantic Modulation through Feature-wise Linear Modulation (FiLM), allowing LLM-derived logical priors to condition the policy's internal activations according to dataset semantics. In addition, FlowPipe incorporates failure awareness into the flow objective to avoid invalid states and concentrate search on high-potential regions. Experiments on two benchmark suites with 74 real-world datasets show that FlowPipe outperforms SOTA baselines, improving accuracy by 11.96% on average and achieving 12.5x faster training convergence. Source code is available at https://github.com/KunyuNi/FlowPipe.

数据清洗生成模型大模型应用自动化流水线

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。