提出首个满足长期约束的在线全能预测动态回归算法
Dynamic Regret Bounds for Online Omniprediction with Long Term Constraints
- 设计在线预测算法,让多个下游决策者在变化环境中保持最优表现
- 实现所有代理的动态后悔值有界,且约束违反量趋于零
- 无需决策者维护状态,只需每轮解决单次优化问题
我们提出一种算法,可为带有长期约束的在线全能预测问题提供动态后悔界。该问题中,学习者需生成一系列预测并广播给多个下游决策者。每个决策者拥有自己的效用函数及一组约束函数,将行动与对抗性选择的状态映射为收益或约束违规项。下游决策者假设状态预测正确,并据此选择行动;学习者的目的是生成预测,使得所有决策者在最坏情况下仍能获得效用保证,同时最小化最坏情况下的约束违规。在此框架下,我们首次提出能对所有代理同时实现动态后悔有界——即每个代理的后悔针对多轮交互中可能变化的行动序列进行度量——并确保每个代理的约束违规量趋于零。我们的结果无需代理自身维护任何状态,仅需根据当前轮次的预测求解单轮约束优化问题。
原文摘要 · Abstract (English)
We present an algorithm guaranteeing dynamic regret bounds for online omniprediction with long term constraints. The goal in this recently introduced problem is for a learner to generate a sequence of predictions which are broadcast to a collection of downstream decision makers. Each decision maker has their own utility function, as well as a vector of constraint functions, each mapping their actions and an adversarially selected state to reward or constraint violation terms. The downstream decision makers select actions "as if" the state predictions are correct, and the goal of the learner is to produce predictions such that all downstream decision makers choose actions that give them worst-case utility guarantees while minimizing worst-case constraint violation. Within this framework, we give the first algorithm that obtains simultaneous \emph{dynamic regret} guarantees for all of the agents -- where regret for each agent is measured against a potentially changing sequence of actions across rounds of interaction, while also ensuring vanishing constraint violation for each agent. Our results do not require the agents themselves to maintain any state -- they only solve one-round constrained optimization problems defined by the prediction made at that round.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。