研究推荐系统中用户探索与利用的公平性问题,发现先来用户会引发后来者的嫉妒。
Envious Explore and Exploit
- 用经济中的嫉妒概念量化不同用户间的收益差异
- 证明奖励一致性机制可提升整体效果但加剧用户间嫉妒
- 提出常数嫉妒算法,在效率与公平间取得平衡
探索与利用权衡在推荐系统中至关重要,旨在通过学习用户历史交互来优化服务。尽管商业上成功,其社会影响尤其是用户间效用差异尚不明确。本文使用经济中的嫉妒概念衡量这种差异,构建了一个类似多臂赌博机的模型,每轮包含多个会话,奖励每轮仅实现一次,称为奖励一致性。我们发现系统可利用此特性改善社会结果,但也会产生嫉妒:晚到用户享受早到用户积累的信息。研究了多种到达顺序机制下产生的嫉妒,覆盖任意匿名算法(不依赖用户身份)。针对均匀到达给出紧致嫉妒界,对可引导到达(系统可影响用户到达顺序)给出嫉妒上界。进一步设计算法,在受限场景下实现恒定嫉妒并逼近最优福利。最后通过模拟验证理论结果。
原文摘要 · Abstract (English)
Explore-and-exploit tradeoffs play a key role in recommendation systems (RSs), aiming at serving users better by learning from previous interactions. Despite their commercial success, the societal effects of explore-and-exploit mechanisms are not well understood, especially regarding the utility discrepancy they generate between different users. In this work, we measure such discrepancy using the economic notion of envy. We present a multi-armed bandit-like model in which every round consists of several sessions, and rewards are realized once per round. We call the latter property reward consistency, and show that the RS can leverage this property for better societal outcomes. On the downside, doing so also generates envy, as late-to-arrive users enjoy the information gathered by early-to-arrive users. We examine the generated envy under several arrival order mechanisms and virtually any anonymous algorithm, i.e., any algorithm that treats all similar users similarly without leveraging their identities. We provide tight envy bounds on uniform arrival and upper bound the envy for nudged arrival, in which the RS can affect the order of arrival by nudging its users. Furthermore, we study the efficiency-fairness trade-off by devising an algorithm that allows constant envy and approximates the optimal welfare in restricted settings. Finally, we validate our theoretical results empirically using simulations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。