在滑动窗口中用2次查询实现近最优后悔值,内存仅需对数级。
Online Learning with Limited Information in the Sliding Window Model
- 用2次查询和极低内存实现滑动窗口最优后悔界。
- 任意时间区间内后悔值达√(n|I|)polylog(nT),内存仅为polylog(nT)。
- 首次在带宽场景下实现亚线性后悔且内存为对数级,适合实时系统。
受流式模型中专家问题研究的启发,本文研究滑动窗口模型下的专家问题。该模型适用于交通监控、疫情追踪和自动交易等场景,强调近期数据的重要性。给定n个专家、T天、每天可查询q个专家的预测,受限于内存,目标是在任意最近W天的窗口内实现近似最优的后悔值√(nW)polylog(nT)。尽管单次查询无法达成此目标,但本文证明:使用2次查询即可实现该后悔界,且仅需polylog(nT)比特内存。算法不仅对滑动窗口最优,且对任意时间区间ℐ均能实现√(n|ℐ|)polylog(nT)后悔,内存相较以往区间后悔算法呈指数级降低。基于此技术,本文进一步解决数据流中的带宽问题(q=1),在polylog(nT)内存下实现n T^{2/3}polylog(T)的后悔值,是流式模型中首个带宽设置下达到亚线性后悔且内存为对数级的结果;若最优专家损失为随机顺序,还可进一步优化至最优的O(√(nT))后悔值。
原文摘要 · Abstract (English)
Motivated by recent work on the experts problem in the streaming model, we consider the experts problem in the sliding window model. The sliding window model is a well-studied model that captures applications such as traffic monitoring, epidemic tracking, and automated trading, where recent information is more valuable than older data. Formally, we have $n$ experts, $T$ days, the ability to query the predictions of $q$ experts on each day, a limited amount of memory, and should achieve the (near-)optimal regret $\sqrt{nW}\text{polylog}(nT)$ regret over any window of the last $W$ days. While it is impossible to achieve such regret with $1$ query, we show that with $2$ queries we can achieve such regret and with only $\text{polylog}(nT)$ bits of memory. Not only are our algorithms optimal for sliding windows, but we also show for every interval $\mathcal{I}$ of days that we achieve $\sqrt{n|\mathcal{I}|}\text{polylog}(nT)$ regret with $2$ queries and only $\text{polylog}(nT)$ bits of memory, providing an exponential improvement on the memory of previous interval regret algorithms. Building upon these techniques, we address the bandit problem in data streams, where $q=1$, achieving $n T^{2/3}\text{polylog}(T)$ regret with $\text{polylog}(nT)$ memory, which is the first sublinear regret in the streaming model in the bandit setting with polylogarithmic memory; this can be further improved to the optimal $\mathcal{O}(\sqrt{nT})$ regret if the best expert's losses are in a random order.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。