arXiv:2607.26566cs.DCcs.AI2026-07

将文本生成图像工作流拆解为独立模型函数,提升资源利用率和调度灵活性。

ServerlessT2I: Efficient Text-to-Image Workflow Serving on a Serverless Platform

论文配图:ServerlessT2I: Efficient Text-to-Image Workflow Serving on a Serverless Platform
图 1 · 摘自论文原文
  • 将T2I工作流分解为松散耦合的模型函数,可独立调度与扩展。
  • 在相同GPU预算下支持2倍请求率,或节省3倍GPU资源。
  • 适合需要高并发、多租户公平调度的生成式AI服务场景。

文本到图像(T2I)工作流正越来越多地部署在无服务器平台上,因为用户常需自定义工作流并间歇性调用。现有平台通常将每个工作流作为封闭的GPU函数部署,统一预置、放置和扩展其中所有模型。这种整体设计隐藏了工作流结构,增加扩展开销,迫使用户管理底层GPU协调,限制了多租户集群中的细粒度公平性。本文提出ServerlessT2I,一种原生无服务器系统,将T2I工作流分解为可独立管理与调度的松散耦合模型函数。通过显式管理单个模型执行,ServerlessT2I实现按模型扩展、声明式工作流组合、透明的GPU内存通信以及公平感知调度。为提升分解效率,ServerlessT2I利用计算密集型T2I推理中闲置的GPU内存构建数据平面,降低模型加载与数据通信开销。该系统还引入多租户公平调度器。基于生产负载数据,ServerlessT2I在相同GPU预算下可维持高达2倍的请求速率;在固定请求速率下,可节省高达3倍的GPU资源,同时满足服务级别目标(SLO)。

原文摘要 · Abstract (English)

Text-to-image (T2I) workflows are increasingly deployed on serverless platforms because users often compose customized workflows and invoke them intermittently. Existing platforms typically deploy each workflow as an opaque GPU function, provisioning, placing, and scaling all constituent models in the workflow together. This monolithic design obscures workflow structure, inflates scaling overhead, forces users to manage low-level GPU coordination, and limits fine-grained fairness in multi-tenant clusters. In this paper, we present ServerlessT2I, a serverless-native system that decomposes a T2I workflow into loosely coupled model functions that can be independently managed and scheduled. By explicitly managing individual model execution, ServerlessT2I enables per-model scaling, declarative workflow composition, transparent GPU-resident communication, and fairness-aware scheduling. To make this decomposition efficient, ServerlessT2I harvests slack GPU memory left idle by compute-bound T2I inference to build a data plane that reduces model loading and data communication overheads. \sys{} further introduces a fair scheduler for multi-tenant serving. Using production traces, ServerlessT2I sustains up to 2$\times$ higher request rates than existing T2I workflow serving systems with the same GPU budget; for a fixed request rate, it saves up to 3$\times$ GPU resources while satisfying service level objectives (SLOs).

生成模型无服务器调度优化T2I

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。