arXiv:2602.11776cs.LGcs.DC2026-02

MUSE实现模型更新无缝切换,解决多租户场景下阈值重校难题。

MUSE: Multi-Tenant Model Serving With Seamless Model Updates

  • 通过动态路由与两级分数转换,解耦模型输出与客户决策边界。
  • 支撑每秒上千事件处理,12个月内累计处理超550亿事件,低延迟高可用。
  • 适合需要频繁更新模型的金融风控等多租户服务场景。

在二分类系统中,决策阈值将模型得分转化为具体动作。选择合适的阈值不仅依赖模型得分分布,还需匹配各客户的具体业务需求。然而,模型重新训练必然改变得分分布,导致原有阈值失效。在多租户评分即服务环境中,决策边界由客户自主管理,这造成严重瓶颈:需协调数百个客户的阈值更新,耗费大量人工时间,导致模型停滞。我们提出MUSE,一种模型服务框架,通过解耦模型得分与客户决策边界,实现无缝模型更新。该框架支持多租户,通过基于意图的动态路由共享模型,结合两级分数转换机制,将模型输出映射到稳定参考分布。已在Feedzai大规模部署,处理速度超过每秒一千事件,过去12个月累计处理超550亿事件,覆盖数十个租户,同时保证高可用与低延迟。模型上线时间从数周缩短至数分钟,提升模型对抗漂移攻击的韧性,累计节省数百万美元欺诈损失与运营成本。

原文摘要 · Abstract (English)

In binary classification systems, decision thresholds translate model scores into actions. Choosing suitable thresholds relies on the specific distribution of the underlying model scores but also on the specific business decisions of each client using that model. However, retraining models inevitably shifts score distributions, invalidating existing thresholds. In multi-tenant Score-as-a-Service environments, where decision boundaries reside in client-managed infrastructure, this creates a severe bottleneck: recalibration requires coordinating threshold updates across hundreds of clients, consuming excessive human hours and leading to model stagnation. We introduce MUSE, a model serving framework that enables seamless model updates by decoupling model scores from client decision boundaries. Designed for multi-tenancy, MUSE optimizes infrastructure re-use by sharing models via dynamic intent-based routing, combined with a two-level score transformation that maps model outputs to a stable, reference distribution. Deployed at scale by Feedzai, MUSE processes over a thousand events per second, and over 55 billion events in the last 12 months, across several dozens of tenants, while maintaining high-availability and low-latency guarantees. By reducing model lead time from weeks to minutes, MUSE promotes model resilience against shifting attacks, saving millions of dollars in fraud losses and operational costs.

模型服务多租户阈值管理实时系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。