设计了一种让专家永远说真话且机制表现接近最优的在线预测方法。
No-regret incentive-compatible online learning under exact truthfulness with non-myopic experts
- 用基于随机游走的扰动策略改进了预测竞赛机制
- 在全信息下实现$ ilde{O}( ext{sqrt}{T N})$的后悔界
- 首次在带奖励反馈中做到完全诚实且无后悔,适合博弈设计场景
研究一个在线预测设置:在 $T$ 轮中,$N$ 个策略性专家各自向机制报告预测,机制选择其中一个,随后真实结果揭晓。每轮中,每个专家对其结果有信念,但希望最大化自己被选中的总次数。机制的目标是实现低信念后悔:其累计损失(基于所选预测)与事后最佳专家损失之差(按专家信念衡量)。本文考虑对非短视专家完全诚实的机制,即诚实地报告信念能严格最大化其未来被选中的主观概率。即使在全信息设定下,此前仍无满足该条件的无后悔机制。我们通过扩展独立事件抽奖预测竞赛机制(I-ELF)提出首个此类无后悔机制。将在线 I-ELF 视为带有损失依赖扰动的随机游走的 Follow the Perturbed Leader(FPL),得到 $ ilde{O}( ext{sqrt}{T N})$ 后悔。结果依赖于我们建立的新泊松二项分布尾部界。进一步推广至带奖惩反馈(bandit)设置,给出首个完全诚实且无后悔的机制,实现 $ ilde{O}(T^{2/3} N^{1/3})$ 后悔;这甚至优于以往近似诚实机制的性能。
原文摘要 · Abstract (English)
We study an online forecasting setting in which, over $T$ rounds, $N$ strategic experts each report a forecast to a mechanism, the mechanism selects one forecast, and then the outcome is revealed. In any given round, each expert has a belief about the outcome, but the expert wishes to select its report so as to maximize the total number of times it is selected. The goal of the mechanism is to obtain low belief regret: the difference between its cumulative loss (based on its selected forecasts) and the cumulative loss of the best expert in hindsight (as measured by the experts' beliefs). We consider exactly truthful mechanisms for non-myopic experts, meaning that truthfully reporting its belief strictly maximizes the expert's subjective probability of being selected in any future round. Even in the full-information setting, it is an open problem to obtain the first no-regret exactly truthful mechanism in this setting. We develop the first no-regret mechanism for this setting via an online extension of the Independent-Event Lotteries Forecasting Competition Mechanism (I-ELF). By viewing this online I-ELF as a novel instance of Follow the Perturbed Leader (FPL) with noise based on random walks with loss-dependent perturbations, we obtain $\tilde{O}(\sqrt{T N})$ regret. Our results are fueled by new tail bounds for Poisson binomial random variables that we develop. We extend our results to the bandit setting, where we give an exactly truthful mechanism obtaining $\tilde{O}(T^{2/3} N^{1/3})$ regret; this is the first no-regret result even among approximately truthful mechanisms.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。