arXiv:2603.06589cs.IRcs.AI2026-03

一个轻量模块统一解决推荐系统的校准与去偏问题。

Isotonic Layer: A Unified Framework for Recommendation Calibration and Debiasing

  • 用可学习的分段线性权重实现端到端校准与去偏。
  • 无需额外数据预处理或倾向估计,支持任意细粒度子群体适配。
  • 适合大规模推荐系统开发者,简化部署与维护成本。

模型校准与去偏是大规模推荐系统中基础但操作成本高昂的挑战。现有方法将二者视为独立问题,需分别构建后处理校准流程、倾向估计工作流及按细分群体部署的模型集群。本文提出等序层(Isotonic Layer),一种可微分的分段线性模块,将两者统一为单一轻量级架构组件——无需额外数据预处理、无需倾向估计、也无需独立校准流程。核心思想是:通过将非负桶权重参数化为可学习的上下文嵌入,模型能从标准训练数据中端到端自动学习所有校准与去偏函数。更换不同嵌入(如位置、设备类型、广告主ID或其组合)即可在任意高维特征空间内即时获得针对该子群体的精准校准,仅需一次嵌入查找,无需工程修改。同一层可同时处理后处理校准、位置去偏及异构多任务偏差修正。本研究提供了一种原理清晰、实用性强的简化方案:一个即插即用的组件,取代了碎片化、高维护成本的校准基础设施。大量生产环境A/B测试验证了其在预测精度、校准保真度与排序一致性上的显著提升。

原文摘要 · Abstract (English)

Model calibration and debiasing are fundamental yet operationally expensive challenges in large-scale recommendation systems. Existing approaches treat them as separate problems requiring distinct infrastructure: post-hoc calibration pipelines, propensity estimation workflows, and per-segment model farms. We introduce the Isotonic Layer, a differentiable piecewise linear module that unifies both problems within a single, lightweight architectural component - requiring no additional data preprocessing, no propensity estimation, and no separate calibration pipelines. The core insight is elegant: by parameterizing non-negative bucket weights as learnable context embeddings, the model automatically learns all calibration and debiasing functions end-to-end from standard training data. Swapping in a different embedding (position, device type, advertiser ID, or any combination) instantly yields calibration tailored to that sub-segment at arbitrary granularity in any high-dimensional feature space, with no engineering changes beyond a single embedding lookup. The same layer handles post-hoc calibration, position debiasing, and heterogeneous multi-task bias correction within one unified framework. This paper offers a principled, practical simplification: a plug-and-play solution that replaces fragmented, high-maintenance calibration infrastructure with a single end-to-end trainable component. Extensive production A/B tests confirm significant improvements in predictive accuracy, calibration fidelity, and ranking consistency.

推荐系统校准去偏轻量模块

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。