轻量协同修正框架,让手机端推荐模型更快更准。
Device-Cloud Collaborative Correction for On-Device Recommendation
- 手机端用自校正网络动态优化参数,测试时低延迟修正
- 相比现有模型参数减少37%,计算量降低41%,性能不降
- 适合资源受限设备部署,兼顾实时性与推荐精度
随着推荐模型和设备算力的快速发展,基于设备的推荐因具备更好的实时性和隐私保护而成为重要研究方向。以往基于Transformer的序列推荐模型虽性能优于基于RNN的模型,但随着交互序列增长,其空间和计算开销显著增加,给设备端部署带来挑战。为此,本文提出设备-云协同修正框架CoCorrRec,通过自校正网络(SCN)在测试阶段以极低时间成本根据输入令牌动态修正模型参数,实现与更复杂Transformer模型相当的性能。为防止SCN过拟合,设计全局校正网络(GCN),处理从设备上传的隐藏状态并提供全局修正方案。在多个数据集上的实验表明,CoCorrRec在性能上优于现有Transformer和RNN类设备推荐模型,同时参数量减少37%、浮点运算量(FLOPs)降低41%,实现了实时性与高效率的平衡。
原文摘要 · Abstract (English)
With the rapid development of recommendation models and device computing power, device-based recommendation has become an important research area due to its better real-time performance and privacy protection. Previously, Transformer-based sequential recommendation models have been widely applied in this field because they outperform Recurrent Neural Network (RNN)-based recommendation models in terms of performance. However, as the length of interaction sequences increases, Transformer-based models introduce significantly more space and computational overhead compared to RNN-based models, posing challenges for device-based recommendation. To balance real-time performance and high performance on devices, we propose Device-Cloud \underline{Co}llaborative \underline{Corr}ection Framework for On-Device \underline{Rec}ommendation (CoCorrRec). CoCorrRec uses a self-correction network (SCN) to correct parameters with extremely low time cost. By updating model parameters during testing based on the input token, it achieves performance comparable to current optimal but more complex Transformer-based models. Furthermore, to prevent SCN from overfitting, we design a global correction network (GCN) that processes hidden states uploaded from devices and provides a global correction solution. Extensive experiments on multiple datasets show that CoCorrRec outperforms existing Transformer-based and RNN-based device recommendation models in terms of performance, with fewer parameters and lower FLOPs, thereby achieving a balance between real-time performance and high efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。