腾讯自研自动化数据仓库交付系统,显著提升任务成功率与效率。
SiriusDeliver: Automating Data Warehouse Delivery at Tencent

- 分层代理协同调度,实现全流程自动化交付
- 交付成功率87.2%,73.5%任务可自主提交
- 适合大规模数据平台运维与工程提效场景
企业级数据仓库支撑关键业务分析,但任务交付流程复杂,涉及上下文检索、工作流配置、代码生成、平台提交和故障诊断。尽管大语言模型与编程智能体提升了软件开发效率,但在生产级数据仓库交付中仍不足,因需依赖关系编排、生命周期管控及持续适配平台实践。本文提出SiriusDeliver,一个端到端的数据仓库任务交付自动化智能体。该系统集成三个模块:分层交付代理用于技能协调,制品生命周期控制模块在平台执行前后验证与修正产出,以及基于轨迹的技能演化机制,从交付历史中提炼可复用能力。通过离线数据集与腾讯云WeData的大规模生产部署评估,结果显示,在6个业务团队、4类任务类型下为期两个月的运行中,服务3600名月活跃用户,完成18240次交付会话,实现87.2%的端到端成功率与73.5%的自主提交率。一个月的A/B测试表明,交付耗时从228分钟降至23分钟,工程师投入从95分钟减至11分钟,最终成功率保持相当。
原文摘要 · Abstract (English)
Enterprise data warehouses (DWs) support business-critical analytics, but warehouse task delivery remains a complicated production process involving context retrieval, workflow configuration, code generation, platform submission, and failure diagnosis. Although large language models (LLMs) and coding agents have improved software development, they are insufficient for production DW delivery, which requires dependency-aware orchestration, lifecycle-aware artifact control, and continuous adaptation to evolving platform practices. We present SiriusDeliver, an end-to-end delivery automation agent for production warehouse task submission. SiriusDeliver integrates three components: a hierarchical delivery agent that orchestrates warehouse skills, an artifact lifecycle control module that verifies and revises artifacts before and after platform execution, and a trace-driven skill evolution mechanism that maintains reusable skills from delivery trajectories. We evaluate SiriusDeliver through offline datasets and large-scale production deployment on Tencent Cloud WeData. Offline experiments on real-world warehouse delivery cases show that SiriusDeliver improves delivery success and automation efficiency over representative baselines. During a two-month deployment across 6 business teams and 4 warehouse task types, SiriusDeliver served 3,600 monthly active users and supported 18,240 delivery sessions, achieving an 87.2% end-to-end success rate and a 73.5% autonomous submission rate. A one-month A/B test shows that SiriusDeliver reduces median delivery time from 228 to 23 minutes and engineer effort from 95 to 11 minutes, while maintaining comparable final delivery success.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。