提出隐私保护的多市场点击率预测方法,解决跨市场数据异构与隐私问题。
FedMM: Federated Collaborative Signal Quantization for Multi-Market CTR Prediction

- 用双层离散码本量化协同嵌入,融合全局共享与本地特有信号。
- 在多个基准数据集上提升点击率预测性能,同时保障用户数据隐私。
- 适合关注多国推荐系统隐私与效果平衡的研究者和工程师。
亚马逊、Netflix等在线平台面向多国用户提供服务,凸显多市场推荐(MMR)的重要性。现有方法多采用预训练-微调范式,在集中化全球数据上训练统一模型后适配各市场,但忽视了市场数据隐私。传统联邦学习虽能保护隐私,但通常仅追求全局模型聚合,未考虑显著的市场异构性;且因各市场ID空间不重叠,基于嵌入的聚合策略失效。为此,本文提出联邦协作信号量化(FedMM)方法,用于多市场点击率(CTR)预测。核心思想是利用离散码本机制实现隐私保护传输并对齐不重叠的ID空间。通过分层码本结构捕捉跨市场共享模式与市场特异性。具体地,每个市场部署带有双层码本机制的残差量化变分自编码器(RQ-VAE),第一层使用联邦更新的全局码本以捕获通用协作模式,第二层保留本地码本学习市场特有语义。最终,融合通用与特定协作信号的离散码被引入下游CTR模型,显著提升所有市场的预测准确率。大量实验表明,FedMM在保障隐私的前提下显著改善推荐性能。
原文摘要 · Abstract (English)
Online platforms such as Amazon and Netflix serve users across multiple countries and regions, underscoring the importance of multi-market recommendation (MMR). Most MMR methods adopt a pre-training and fine-tuning paradigm, in which a unified model is first trained on centralized, global data and subsequently adapted to specific markets. However, this approach ignores the privacy of market data. While traditional federated learning preserves privacy, it typically aims to obtain a global model by aggregating model parameters and does not account for significant market heterogeneity. Additionally, because ID spaces are disjoint across markets, embedding-based aggregation strategies become ineffective. To overcome these challenges, we propose a federated collaborative signal quantization (FedMM) method for multi-market click-through rate (CTR) prediction. Our core idea leverages a discrete codebook mechanism to achieve privacy-preserving transmission and align disjoint ID spaces. We further employ a hierarchical codebook structure to capture cross-market shared patterns and market-specific characteristics. Specifically, we deploy a residual quantized variational autoencoder (RQ-VAE) with a dual-layer codebook mechanism for each market to quantize collaborative embeddings. The first layer utilizes a global federated codebook, updated via aggregation to capture universally shared collaborative patterns, while the second layer maintains a local codebook to learn market-specific semantics. Finally, the learned discrete codes, which integrate both general and specific collaborative signals, are incorporated into downstream CTR models to enhance prediction accuracy across all markets. Extensive experiments on benchmark datasets demonstrate that FedMM significantly improves recommendation performance with privacy guarantees.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。