arXiv:2608.19838cs.AIcs.PL2026-08

提出以变更规范为单位的治理方法,提升数据平台变更可审查性。

Specification-delta-driven data governance: an empirical study of the «spec-delta» as the unit of change in lakehouse data platforms

  • 以规范增量(spec-delta)为变更单元,替代传统代码提交流程。
  • 实验显示该方法缩短部署时间,降低银层金层缺陷密度,减少指标分歧。
  • 适合需高可追溯性的数据平台团队,尤其关注合规与协作效率者。

规范驱动开发(SDD)主张以规范而非代码作为人工智能辅助工作的核心产物。尽管已有工具如GitHub Spec Kit及宪法式SDD等形式化了这一原则,且执行数据契约研究扩展至运行时的模式与质量校验,但对规范增量——即每次变更应产生可审查的需求增量——在数据平台中的实证研究仍属空白。事实上,许多数据平台变更涉及合同性内容(新数据集、服务级别协议、度量语义、访问策略),而不仅是代码变动。本文形式化了spec-delta概念,提出根据增量规范适用性对数据平台变更进行分类的分类法,并设计对照实验,比较spec-delta工作流与传统代码拉取请求流程。评估指标包括从发现到部署时间、银层与金层缺陷密度、跨工具度量偏差,以及通过NASA TLX测量的评审者认知负荷。论文特别预留演示与实验章节用于真实湖仓环境实例化。贡献不在于工具,而在于可复现的证据与适用性指南,帮助避免过早过度规范的反模式。

原文摘要 · Abstract (English)

Spec Driven Development SDD has consolidated the idea that the specification rather than the code should be the primary artefact governing AI assisted work. Tools such as GitHub Spec Kit, and proposals such as Constitutional SDD, have formalised this principle in the software domain, while the executable data-contracts literature has extended it to schema and quality enforcement at run time. Nevertheless, the treatment of the specification delta OpenSpec's core idea that every change should produce a reviewable increment of requirements as the unit of change in data platforms remains empirically unexplored, even though many data-platform changes are contractual (new datasets, service-level agreements, metric semantics, access policies) rather than purely code changes. This work formalises the spec-delta concept, proposes a taxonomy of data platform changes according to their suitability for incremental specification, and defines a controlled experiment comparing a spec-delta-driven workflow against a conventional code pull-request workflow without a delta. The response variables are discovery to deployment time, the density of defects reaching the Silver and Gold lakehouse layers, cross-tool metric divergence, and reviewer cognitive load measured with NASA TLX. The paper explicitly reserves a demonstration-and-laboratory section for instantiation on a real lakehouse environment. The contribution is not a tool but reproducible evidence and an applicability guide that helps to avoid the up front over specification antipattern.

数据治理规范驱动湖仓架构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。