arXiv:2605.27131cs.ETcs.AI2026-05

用AI增强的湖仓架构,让数据团队既自主又可控。

Beyond the Data Mesh Illusion: Designing Modern AI-augmented Lakehouses to Bridge the Gap Between Theory and Practice

  • 用AI自动标准化数据、生成规则、审查变更,减轻治理负担。
  • 通过自然语言接口让业务人员也能访问数据,提升使用率。
  • 分阶段将控制权交给各业务团队,避免混乱或卡点。

企业数据平台长期面临领域自治与全局治理之间的矛盾。数据网格虽提倡去中心化所有权,但纯实施常因缺乏平台能力、工具支持和协调机制而效果不佳。本文提出在现代湖仓架构上构建AI增强的中心-辐射模型:中心(卓越中心)提供共享服务、策略自动化和AI治理,自动标准化数据产品、生成质量规则、起草数据契约并审查变更;各业务单元(辐条)负责业务语义、产品需求和迭代节奏,随成熟度逐步承担更多责任。同一类大模型不仅辅助治理,还降低业务与数据工程融合的门槛,使团队能实现端到端自主,同时减少对中心的依赖。自然语言交互界面进一步让业务用户轻松访问历史未被充分利用的企业数据。组织层面提出分阶段所有权转移框架,避免集中瓶颈或无序去中心化。通过数据产品采纳率、发现时间、洞察时间三项指标评估,将平台成功与可衡量的商业价值挂钩。

原文摘要 · Abstract (English)

Enterprise data platforms face an enduring tension between domain self-service and holistic governance. The data mesh paradigm proposed decentralized domain ownership as a remedy, but pure implementations frequently underdeliver: teams inherit new responsibilities without the platform maturity, tooling, or coordination mechanisms needed to exercise them effectively. This paper argues that the flexibility-versus-control trade-off can be relaxed through an AI-augmented hub-and-spoke model layered on a modern lakehouse architecture. A central hub (Center of Excellence) provides shared platform services, policy automation, and AI-enabled governance, automatically standardizing data products, generating quality rules, drafting data contracts, and reviewing changes for regressions. Domain spokes own business semantics, product backlogs, and local iteration cadence, progressively assuming greater responsibility as they mature. The same LLMs that automate governance tasks also lower the barrier for domain practitioners to develop genuine cross-functional expertise spanning business and data engineering, enabling spoke teams to take on greater end-to-end ownership without proportionally increasing their dependence on the hub. Natural-language conversational interfaces further democratize access for business users, exposing historically underutilized enterprise data. On the organizational side, we propose a staged framework that shifts ownership from hub to spokes, avoiding both centralized bottlenecks and uncoordinated decentralization. We evaluate the architecture through three outcome metrics: data product adoption, time-to-find, and time-to-insight, that tie platform success to measurable business value rather than internal activity.

湖仓架构AI治理数据网格企业数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。