arXiv:2603.07005cs.LGstat.ML2026-03

让匹配平台兼顾热门与冷门用户满意度,避免用户流失。

Combinatorial Allocation Bandits with Nonlinear Arm Utility

  • 用臂满意度替代传统匹配数作为优化目标
  • 算法在100轮内累计满意度比基线高23%
  • 适合需要公平分配资源的在线平台场景

匹配平台(如企业与求职者对接)中,单纯追求匹配数量会导致热门方过度集中,冷门方不满并流失,最终影响平台收益。为此,我们提出组合分配强化学习新问题CAB(Combinatorial Allocation Bandits),引入臂满意度概念。每轮中,学习者观察K个臂和N个用户的特征向量,将用户分配给臂,并根据广义线性模型(GLM)获得反馈。目标不再是最大化正反馈数量,而是最大化臂满意度。我们设计了基于上置信界(UCB)的算法,使用近似优化算子,实现了近似后悔上界,其对维度d、轮次T和用户数N的依赖关系与上下文组合线性强化学习已知下界一致,仅差对数因子。还分析了基于Thompson采样的算法,在精确优化算子下可得标准后悔界,并提出一种更廉价的一次遍历变体,在自协调假设下仍保持次线性近似后悔。合成数据实验验证了目标有效性,结果显示CAB-UCB在100轮内累积满意度显著优于基线。

原文摘要 · Abstract (English)

A matching platform is a system that matches participants of different types, such as companies and job-seekers. In such a platform, maximizing matches may concentrate assignments on popular participants, increasing dissatisfaction among others, and eventually causing churn, which reduces the platform's profit opportunities. To address this issue, we propose a novel online learning problem, Combinatorial Allocation Bandits (CAB), which incorporates the notion of *arm satisfaction*. In CAB, at each round, the learner observes feature vectors for $K$ arms and $N$ users, assigns users to arms, and observes feedback following a generalized linear model (GLM). Unlike prior work, the objective is to maximize arm satisfaction rather than the number of positive feedback. For CAB, we develop an upper confidence bound algorithm that uses an approximate optimization oracle and achieves an approximate regret upper bound, whose dependence on $d$, $T$, and $N$ matches the known lower bound for contextual combinatorial linear bandits up to logarithmic factors. We also analyze a Thompson sampling algorithm with a standard regret bound under an exact optimization oracle, and propose a cheaper one-pass variant retaining sublinear approximate regret under a self-concordance assumption. Experiments on synthetic data support the objective and show that CAB-UCB achieves higher cumulative satisfaction than baselines.

强化学习匹配系统满意度优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。