arXiv:2508.07179cs.CLcs.AI2025-08被引 1

自动化提取多语言数据管道中的细粒度模式血缘,解决数据语义漂移问题。

Schema Lineage Extraction at Scale: Multilingual Pipelines, Composite Evaluation, and Language-Model Benchmarks

  • 通过识别源模式、表、转换逻辑与聚合操作,构建标准化数据变换表示。
  • 12个模型实验表明,模型规模与提示技巧决定提取性能,32B开源模型达GPT级效果。
  • 适用于需保障数据可复现与治理的工业场景,如RAG与文本转SQL系统。

企业数据管道通常涉及多种编程语言的复杂转换,导致原始元数据与下游数据之间出现语义断层,即“语义漂移”,影响数据可复现性、治理能力,并削弱检索增强生成(RAG)和文本转SQL系统等服务的效用。为此,本文提出一种自动化提取多语言企业管道脚本中细粒度模式血缘的新框架。该方法识别四个核心组件:源模式、源表、转换逻辑与聚合操作,生成标准化的数据变换表示。为严格评估血缘质量,提出新型综合评价指标SLiCE,同时评估结构正确性与语义保真度。此外,构建了包含1700条真实工业脚本人工标注血缘的新基准。在12个语言模型上进行实验,涵盖1.3B至32B的小语言模型(SLMs)及大语言模型(LLMs)如GPT-4o与GPT-4.1。结果表明,模式血缘提取性能随模型规模与提示技术复杂度提升而增长。特别地,一个32B开源模型仅通过单一推理轨迹即可达到标准提示下GPT系列的性能水平,表明其在实际应用中部署感知数据的智能代理具备可扩展且经济高效的优势。

原文摘要 · Abstract (English)

Enterprise data pipelines, characterized by complex transformations across multiple programming languages, often cause a semantic disconnect between original metadata and downstream data. This "semantic drift" compromises data reproducibility and governance, and impairs the utility of services like retrieval-augmented generation (RAG) and text-to-SQL systems. To address this, a novel framework is proposed for the automated extraction of fine-grained schema lineage from multilingual enterprise pipeline scripts. This method identifies four key components: source schemas, source tables, transformation logic, and aggregation operations, creating a standardized representation of data transformations. For the rigorous evaluation of lineage quality, this paper introduces the Schema Lineage Composite Evaluation (SLiCE), a metric that assesses both structural correctness and semantic fidelity. A new benchmark is also presented, comprising 1,700 manually annotated lineages from real-world industrial scripts. Experiments were conducted with 12 language models, from 1.3B to 32B small language models (SLMs) to large language models (LLMs) like GPT-4o and GPT-4.1. The results demonstrate that the performance of schema lineage extraction scales with model size and the sophistication of prompting techniques. Specially, a 32B open-source model, using a single reasoning trace, can achieve performance comparable to the GPT series under standard prompting. This finding suggests a scalable and economical approach for deploying schema-aware agents in practical applications.

数据血缘多语言RAG评估基准

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。