在隐私限制下,用掩码与对齐路径提升广告点击率预测精度。
RAMP: Robust Ad Recommendation Under Limited Personalized-Feature Availability via Masking and Alignment Pathways

- 双塔结构分离个性化与非个性化信号,通过掩码实现独立预测。
- 非个性化路径仅用非隐私特征训练,保持基础性能。
- 跨路径对齐机制使无个性化特征时表现优于现有方法。
点击率(CTR)和转化率(CVR)预测是在线广告的核心任务,旨在基于多种特征估计用户交互概率。尽管年龄、性别等个性化属性能显著提升预测精度,但受隐私法规限制,其可用性日益受限,影响训练与推理数据。为此,我们提出RAMP(Robust Ad Recommendation Under Limited Personalized-Feature Availability via Masking and Alignment Pathways),在个性化特征不可用时仍能提升CTR/CVR预测准确率,支持隐私约束场景下的部署。RAMP包含:(i) 双塔结构的个性化路径,输入相同但参数独立,输出掩码分离个性化与非个性化信号;(ii) 仅使用非个性化特征训练的独立非个性化路径;(iii) 借鉴知识蒸馏的预测对齐架构,增强无个性化特征时的预测效果。我们在公开基准和工业数据集上进行多组实验,涵盖不同主干模型及有/无个性化特征设置。结果表明,当个性化特征缺失时,RAMP始终优于现有最先进方法,且在全特征可用时保持竞争力。代码已开源。
原文摘要 · Abstract (English)
Click-through rate (CTR) and conversion rate (CVR) prediction are fundamental tasks in online advertising, aiming to estimate the likelihood of user interactions based on various features. While personalized attributes such as age and gender can significantly enhance predictive accuracy, their use is increasingly restricted by privacy regulations, thereby limiting available data for both training and inference. To address this challenge, we propose RAMP (Robust Ad Recommendation Under Limited Personalized-Feature Availability via Masking and Alignment Pathways), which is designed to improve CTR/CVR prediction accuracy when personalized features are not accessible, thus supporting deployment in privacy-constrained settings.RAMP consists of (i) a personalized pathway built upon a dual-tower component with identical inputs but independent parameters, where output masking separates predictions for personalized and non-personalized signals, (ii) a separate non-personalized pathway trained with non-personalized features only, and (iii) a distillation-inspired prediction-alignment architecture between (i) and (ii) that improves prediction when personalized features are unavailable. We conduct comprehensive experiments using both public benchmarks and industrial datasets to evaluate the performance of RAMP. Our evaluation spans multiple backbone models and different settings: with and without access to personalized features. The results show that RAMP consistently outperforms state-of-the-art methods when personalized features are missing, while maintaining competitive performance when all features are available. %demonstrating its effectiveness and practicality for real-world advertising systems. Our code is publicly available at https://github.com/Ruixinhua/RAMP.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。