arXiv:2608.04502cs.DCcs.AI2026-08

比较了拆分注意力与前馈网络的部署方式,发现并非总是更高效。

AFD-Ledger: Deployment Provisioning for Attention--FFN Disaggregation

论文配图:AFD-Ledger: Deployment Provisioning for Attention--FFN Disaggregation
图 1 · 摘自论文原文
  • 用解析模型和受限搜索,快速估算拆分与集中部署的性能
  • 减少80%以上评估开销,仍能找出最优部署方案
  • 适合想优化大模型服务成本的系统工程师

注意力-前馈网络拆分(AFD)是服务混合专家(MoE)语言模型的一种新兴架构。现有AFD系统虽提升了执行效率,但未回答关键问题:在相同模型、工作负载、每输出令牌时间(TPOT)服务等级目标(SLO)、硬件预算、硬件目录和运行时能力下,AFD是否比最优集中部署具有更高吞吐量?解答此问题需联合优化两种架构的硬件分配与部署组织,导致穷举式规划代价过高。本文提出AFD-Ledger,一种离线解析式部署规划系统,通过解析执行模型与评估受限的硬件搜索,独立规划AFD与集中部署。在可穷举验证的部署空间中,AFD-Ledger将完整部署评估减少68.8%–83.5%,同时仍能获得全局最优部署。在三个真实LongCat 2.0部署中,其预测的AFD对集中部署吞吐量误差仅为6.6%–9.6%。基于该验证框架,我们发现同质化AFD仅在少数场景提升固定预算下的吞吐量;异构AFD依赖部署级硬件互补性,而非启发式设备选择;角色专用硬件改进主要在能跨越部署能力-价格边界时才显著影响部署组织。

原文摘要 · Abstract (English)

Attention--Feed-Forward Network (FFN) Disaggregation (AFD) is emerging as a promising architecture for serving Mixture-of-Experts (MoE) language models. While existing AFD systems improve the efficiency of disaggregated execution, they leave a deployment question unanswered: under the same model, workload, time-per-output-token (TPOT) service-level objective (SLO), hardware budget, hardware catalog, and runtime capabilities, does AFD provide higher throughput than the best collocated deployment? Answering this question requires jointly optimizing hardware assignment and deployment organization for both architectures, making exhaustive provisioning prohibitively expensive. We present AFD-Ledger, an offline analytical provisioning system that independently provisions AFD and collocated deployments using an analytical execution model and an evaluation-bounded hardware search. Across deployment spaces where exhaustive provisioning is feasible, AFD-Ledger reduces complete deployment evaluations by 68.8%--83.5% while still recovering the globally optimal deployment. On three physical LongCat 2.0 deployments, it preserves the correct architecture decision while predicting AFD-to-collocated throughput within 6.6%--9.6% of measurement. Using this validated framework, we show that homogeneous AFD improves fixed-budget throughput in only a minority of the studied settings, heterogeneous AFD requires deployment-level hardware complementarity rather than heuristic device selection, and role-specific hardware improvements matter primarily when they enable better deployment organizations by crossing deployment capability--price boundaries.

模型部署MoE性能优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。