arXiv:2509.17553cs.AIcs.DB2025-09被引 2

无需目标数据即可自动完成数据迁移,提升真实场景可用性。

MontePrep: Monte-Carlo-Driven Automatic Data Preparation without Target Data Instances

  • 用LLM驱动的树搜索生成数据处理流程
  • 在无目标实例条件下仍实现90%以上准确率
  • 适合缺乏数据权限的工业级数据迁移场景

在商业系统中,将异构源数据转换为标准模式的目标数据是普遍需求。以往方法依赖人工标注或访问目标表权限,限制了实际应用。为此,我们提出无需训练、无需目标实例的端到端自动数据准备框架MontePrep。该框架将问题建模为基于大语言模型(LLM)的树结构搜索,包含三个核心组件:数据准备动作沙箱(DPAS)、基础流程生成器(FPG)和执行感知流程优化器(EPO)。DPAS作为轻量级动作空间,避免无效流程探索;FPG通过LLM驱动的蒙特卡洛树搜索,在预定义动作库中逐步构建可执行流程;EPO通过实际执行源到目标的数据迁移结果,评估流程可靠性,剔除不合理方案,从而兼顾效率与有效性。大量实验表明,MontePrep相较五种先进方法均有显著提升。

原文摘要 · Abstract (English)

In commercial systems, a pervasive requirement for automatic data preparation (ADP) is to transfer relational data from disparate sources to targets with standardized schema specifications. Previous methods rely on labor-intensive supervision signals or target table data access permissions, limiting their usage in real-world scenarios. To tackle these challenges, we propose an effective end-to-end ADP framework MontePrep, which enables training-free pipeline synthesis with zero target-instance requirements. MontePrep is formulated as an open-source large language model (LLM) powered tree-structured search problem. It consists of three pivot components, i.e., a data preparation action sandbox (DPAS), a fundamental pipeline generator (FPG), and an execution-aware pipeline optimizer (EPO). We first introduce DPAS, a lightweight action sandbox, to navigate the search-based pipeline generation. The design of DPAS circumvents exploration of infeasible pipelines. Then, we present FPG to build executable DP pipelines incrementally, which explores the predefined action sandbox by the LLM-powered Monte Carlo Tree Search. Furthermore, we propose EPO, which invokes pipeline execution results from sources to targets to evaluate the reliability of the generated pipelines in FPG. In this way, unreasonable pipelines are eliminated, thus facilitating the search process from both efficiency and effectiveness perspectives. Extensive experimental results demonstrate the superiority of MontePrep with significant improvement against five state-of-the-art competitors.

自动数据准备LLM应用无监督迁移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。