用可定制的去偏框架,让推荐系统更公平地处理用户、内容和模型三类偏差。
MBD: A Model-Based Debiasing Framework Across User, Content, and Model Dimensions
- 基于分布建模,从原始行为信号中提取无偏表示
- 支持个性化与自适应的无偏定义,避免系统剧烈波动
- 轻量级集成,无需额外服务架构,适合线上部署
现代推荐系统通过价值模型聚合多种行为信号进行排序,但常见信号本身存在异质性偏差:观看时长天然偏好长视频,循环率偏向短视频,评论概率则偏好视频而非图片。这些偏差导致两个核心问题:(1) 价值模型评分可能系统性偏离用户真实偏好——例如,低点赞概率对极少互动的用户可能代表强烈兴趣;(2) 价值建模规则变更会引发生态突变。本文提出通用的基于模型的去偏(MBD)框架,在用户定义的“无偏”标准下,将有偏信号系统性转换为无偏表示。通过条件化灵活特征子集,直接估计任意群体(如特定视频长度或用户区域)的参与分布均值与方差,实现对原始信号的去偏转换,并生成适用于价值模型的校准信号(如百分位数或Z分数)。无偏定义可灵活控制,适配不同个性化目标与建模偏好。该框架作为现有MTML排序模型的轻量级内置分支,无需独立部署基础设施。
原文摘要 · Abstract (English)
Modern recommendation systems rank candidates by aggregating multiple behavioral signals through a value model. However, many commonly used signals are inherently affected by heterogeneous biases. For example, watch time naturally favors long-form content, loop rate favors short - form content, and comment probability favors videos over images. Such biases introduce two critical issues: (1) value model scores may be systematically misaligned with users' relative preferences - for instance, a seemingly low absolute like probability may represent exceptionally strong interest for a user who rarely engages; and (2) changes in value modeling rules can trigger abrupt and undesirable ecosystem shifts. In this work, we ask a fundamental question: can biased behavioral signals be systematically transformed into unbiased signals, under a user - defined notion of ``unbiasedness'', that are both personalized and adaptive? We propose a general, model-based debiasing (MBD) framework that addresses this challenge by augmenting it with distributional modeling. By conditioning on a flexible subset of features (partial feature set), we explicitly estimate the contextual mean and variance of the engagement distribution for arbitrary cohorts (e.g., specific video lengths or user regions) directly alongside the main prediction. This integration allows the framework to convert biased raw signals into unbiased representations, enabling the construction of higher-level, calibrated signals (such as percentiles or z - scores) suitable for the value model. Importantly, the definition of unbiasedness is flexible and controllable, allowing the system to adapt to different personalization objectives and modeling preferences. Crucially, this is implemented as a lightweight, built-in branch of the existing MTML ranking model, requiring no separate serving infrastructure.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。