arXiv:2605.01055cs.DCcs.AI2026-05

SCION动态选优缓存策略,提升非平稳负载下的命中率。

SCION: Size-aware Policy Orchestration for Nonstationary Object Caches (Long Paper Version)

论文配图:SCION: Size-aware Policy Orchestration for Nonstationary Object Caches (Long Paper Version)
图 1 · 摘自论文原文
  • 基于轻量指纹实时选择最佳缓存策略
  • 在多数工作负载上优于SIEVE,平均接近最优专家
  • 适合需要灵活权衡命中率与性能的云边缓存场景

对象缓存在云和边缘服务中至关重要,但生产负载具有异构性、非平稳性和吞吐约束。近期无机器学习策略如SIEVE和S3-FIFO已形成强基线,因此任何学习方法必须兼顾开销、对漂移的鲁棒性,并超越强专家。我们提出SCION,一种轻量级策略编排框架,通过计算关键路径上的微小工作负载指纹,在少数可部署策略间进行选择。原型AUTO利用对象大小、可缓存性、重用性及缓存大小的短前缀统计量,结合离线训练的线性选择器,从GDSF、S3-FIFO、SIEVE、LHD、W-TinyLFU-AV和DynamicAdaptiveClimb中择优;更简版SCION-P90仅使用p90阈值。在30个公开对象缓存追踪及独立HR-Cache模拟器子集的纯CPU、追踪驱动评估中,AUTO在多数工作负载上使仅可缓存对象的未命中率低于SIEVE,平均表现接近最佳单策略专家,支持显式OMR/BMR权衡选择,且在字节未命中率上仍具竞争力。在快速策略预算下,AUTO-fast成本低于最佳固定快速策略。SCION降低策略错配风险,同时保持热路径不变。

原文摘要 · Abstract (English)

Object caches underpin cloud and edge services, but production workloads are heterogeneous, nonstationary, and throughput-constrained. Recent simple non-ML policies such as SIEVE and S3-FIFO set a strong baseline, so any learned method must be overhead-aware, robust under drift, and competitive with strong experts. We present SCION, a lightweight policy-orchestration framework that selects among a small set of deployable cache policies using a tiny workload fingerprint computed off the critical path. Our prototype, AUTO, uses short-prefix statistics of object size, cacheability, reuse, and cache size, then applies an offline-trained linear selector to choose among GDSF, S3-FIFO, SIEVE, LHD, W-TinyLFU-AV, and DynamicAdaptiveClimb; a simpler SCION-P90 variant uses only a p90 threshold. In a CPU-only, trace-driven evaluation on 30 public object-cache traces and a separate HR-Cache simulator subset, AUTO improves cacheable-only object miss ratio over SIEVE on a majority of workloads, stays close to the best single expert on average, enables explicit OMR/BMR tradeoff selection, and remains competitive on byte miss ratio. Under a fast-policy budget, AUTO-fast achieves lower cost than the best fixed fast policy. SCION reduces regime-mismatch risk while keeping the hot path unchanged.

缓存优化策略编排非平稳负载

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。