arXiv:2605.08267cs.SEcs.AI2026-05被引 4

为复杂AI后端设计统一请求契约,实现集中治理与可观测性。

Execution Envelopes: A Shared Admission Contract for Backend AI Execution Requests

  • 提出执行封套作为标准化请求载体,记录请求者、资源需求与权限范围。
  • 明确区分请求与实际授予资源,确保治理行为可追溯且不干扰原有流程。
  • 适合需要统一管控多类AI任务的工程团队,尤其适用于企业级系统集成。

企业级AI后端日益接收多种类型的执行请求,包括模型部署、推理、评估、数据移动及智能体工作流等。这些请求以服务特定格式到达,导致难以在准入阶段统一附加日志、治理提示、资源计费、授权策略钩子和后续运行时审查,而无需在每个子系统中重复构建相同契约。本文提出执行封套(Execution Envelope),一种标准化的内部准入对象,用于记录请求方、请求的执行类型、所需资源、相关的策略作用域以及后端最终授予的资源。该设计保持聚焦:不替代服务特定请求模型,不执行调度,也不引入新权限令牌。它仅定义一个描述性的准入接口,可贯穿真实后端路径,在具体服务处理前嵌入。我们形式化了请求与授予资源的区分,明确了字段族、不变性及生命周期,并以 /serving/deploy_model 为例验证其可行性。该设计与使用控制、可分析授权、准入控制和集群调度等概念相对比,核心主张是:共享执行准入契约是现代AI后端缺失的关键基础设施,可在不解决放置、策略或运行时执行的前提下,集中实现治理与可观测性。

原文摘要 · Abstract (English)

Enterprise AI backends increasingly admit heterogeneous execution requests across model deployment, inference, evaluation, data movement, and agentic workflows. In many systems, those requests arrive in service-specific shapes, which makes it difficult to attach shared admission-time behavior such as logging, governance hints, resource accounting, authorization-aware policy hooks, and later runtime review without rebuilding the same contract in each subsystem. This paper introduces the execution envelope, a normalized internal admission object that records who is asking for what kind of execution, what resources were requested, what policy-relevant scope accompanied the request, and what the backend ultimately granted. The proposal is intentionally narrow. It does not replace service-specific request models, perform scheduling, or introduce a new authority token. Instead, it defines a descriptive admission seam that can be threaded through real backend paths before backend-specific resolution begins. I formalize the distinction between requested and granted resources, specify the field families, invariants, and lifecycle of the envelope, work through POST /serving/deploy_model as an initial proving ground, and position the design relative to usage control, analyzable authorization, admission control, and cluster scheduling. The central claim is that a shared execution-admission contract is a useful missing primitive for modern AI backends because it creates one place to attach governance and observability without pretending to solve placement, policy, and runtime execution in a single step.

AI治理系统设计请求契约

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。