提出新缓存策略,在不增加开销前提下实现最优淘汰性能。
No-Regret Mixing of LRU and LFU with Optimal Switching Cost
- 用在线学习中的Hedge算法混合虚拟LRU与LFU缓存
- 理论证明可实现次线性后悔,优于单一策略
- 适合对缓存效率要求高的系统设计者
缓存系统常用最近最少使用(LRU)和最少频繁使用(LFU)等简单淘汰策略,二者在互补请求模式下表现良好。近期如LeCar、Cacheus等策略借鉴在线学习的专家问题思想,通过历史淘汰记录更新得分并随机选择LRU或LFU。然而,这些策略是否能在所有请求序列上渐近地达到优于或等于更好策略(即最小化相对于最优的后悔)仍不明确。本文首先证明,即使使用无限历史信息,LeCar在盲对抗敌手下仍存在线性后悔。为此,我们提出H-MC:一种基于Hedge算法的虚拟LRU与LFU缓存混合策略,保持Hedge的选中概率及后悔界,同时在所有具有相同边际概率的联合规则中最小化切换成本。
原文摘要 · Abstract (English)
Caching systems often rely on simple eviction policies such as Least Recently Used (LRU) and Least Frequently Used (LFU), which perform well in complementary request regimes. Recent policies such as LeCar and Cacheus combine LRU and LFU using ideas from the experts problem in online learning. Specifically, upon a miss, they randomize between the two eviction rules using probabilities derived from scores updated by tracking the history of past evictions. While these policies exhibit strong empirical performance, it remains unclear whether they are guaranteed, on every request sequence, to perform asymptotically as well as the better of LRU and LFU, i.e., whether they achieve sublinear regret with respect to this benchmark. We first show that LeCar suffers linear regret against an oblivious adversary, even with unbounded history. We then propose H-MC, a Hedge-based mixture of virtual LRU and LFU caches that preserves Hedge's selection probabilities, and hence its regret guarantees, while minimizing the switching cost among all joint selection rules with these marginals.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。