用图结构统一建模用户收益,提升非线性推荐效果
Laplacian Kernelized Bandit
- 结合图平滑与个体粗糙度,构建多用户统一核函数
- 理论证明可将多用户问题转化为单一函数学习,有效维数更低
- 适合有用户关系的推荐系统,尤其在非线性场景表现优越
我们研究多用户上下文老虎机问题,其中用户通过图关联,且收益函数具有非线性特征和图同质性。提出一种联合惩罚项,融合基于RKHS距离的图平滑项与个体粗糙度惩罚。核心贡献是证明该惩罚等价于单一多用户RKHS中的平方范数,并显式推导出其再生核,巧妙融合图拉普拉斯与基础臂核。这一统一使问题可重述为学习一个''提升''函数,从而设计出基于高斯过程后验的算法LK-GP-UCB和LK-GP-TS。提供高概率后悔界,其依赖于多用户核的有效维度,取代对用户数或环境维度的依赖。实验表明,在非线性场景下优于强线性及无图基线,即使真实收益为线性也保持竞争力。本工作提供了融合拉普拉斯正则化与核化老虎机的统一、理论严谨且实用的框架。
原文摘要 · Abstract (English)
We study multi-user contextual bandits where users are related by a graph and their reward functions exhibit both non-linear behavior and graph homophily. We introduce a principled joint penalty for the collection of user reward functions $\{f_u\}$, combining a graph smoothness term based on RKHS distances with an individual roughness penalty. Our central contribution is proving that this penalty is equivalent to the squared norm within a single, unified \emph{multi-user RKHS}. We explicitly derive its reproducing kernel, which elegantly fuses the graph Laplacian with the base arm kernel. This unification allows us to reframe the problem as learning a single ''lifted'' function, enabling the design of principled algorithms, \texttt{LK-GP-UCB} and \texttt{LK-GP-TS}, that leverage Gaussian Process posteriors over this new kernel for exploration. We provide high-probability regret bounds that scale with an \emph{effective dimension} of the multi-user kernel, replacing dependencies on user count or ambient dimension. Empirically, our methods outperform strong linear and non-graph-aware baselines in non-linear settings and remain competitive even when the true rewards are linear. Our work delivers a unified, theoretically grounded, and practical framework that bridges Laplacian regularization with kernelized bandits for structured exploration.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。