让手机端推荐模型自适应个性化,边云协同实现高效推理
CHORD: Customizing Hybrid-precision On-device Model for Sequential Recommendation with Device-cloud Collaboration
- 用通道级混合精度量化,动态适配不同设备资源
- 仅用2比特/通道编码策略,通信开销降低93.75%以上
- 无需本地重训练,支持实时个性化推荐,适合移动端部署
随着移动设备能力提升,将重排序模型直接部署于设备上实现实时上下文推荐成为可能。迁移模型时,由于设备资源异构,必须进行模型压缩。现有量化方法忽略设备特定的用户兴趣,导致推荐准确率下降;而本地微调虽能捕捉个性化偏好,却需额外计算开销。为此,我们提出一种边云协同的定制化混合精度设备端序列推荐框架(CHORD),利用通道级混合精度量化实现个性化与资源自适应部署。CHORD在异构设备间分发随机初始化模型,通过云端辅助超网络模块识别用户关键参数。基于多粒度(层、滤波器、元素)的参数敏感性分析,精准映射用户画像至量化策略。设备端采用混合精度量化实现动态模型适配与加速推理,无需反向传播,避免昂贵的重训练周期。通过仅用2比特/通道编码量化策略,相比32比特权重,通信开销显著降低。在三个真实数据集和两种主流骨干网络(SASRec、Caser)上的实验表明,CHORD在准确性、效率和自适应性方面均表现优异。
原文摘要 · Abstract (English)
With the advancement of mobile device capabilities, deploying reranking models directly on devices has become feasible, enabling real-time contextual recommendations. When migrating models from cloud to devices, resource heterogeneity inevitably necessitates model compression. Recent quantization methods show promise for efficient deployment, yet they overlook device-specific user interests, resulting in compromised recommendation accuracy. While on-device finetuning captures personalized user preference, it imposes additional computational burden through local retraining. To address these challenges, we propose a framework for \underline{\textbf{C}}ustomizing \underline{\textbf{H}}ybrid-precision \underline{\textbf{O}}n-device model for sequential \underline{\textbf{R}}ecommendation with \underline{\textbf{D}}evice-cloud collaboration (\textbf{CHORD}), leveraging channel-wise mixed-precision quantization to simultaneously achieve personalization and resource-adaptive deployment. CHORD distributes randomly initialized models across heterogeneous devices and identifies user-specific critical parameters through auxiliary hypernetwork modules on the cloud. Our parameter sensitivity analysis operates across multiple granularities (layer, filter, and element levels), enabling precise mapping from user profiles to quantization strategy. Through on-device mixed-precision quantization, CHORD delivers dynamic model adaptation and accelerated inference without backpropagation, eliminating costly retraining cycles. We minimize communication overhead by encoding quantization strategies using only 2 bits per channel instead of 32-bit weights. Experiments on three real-world datasets with two popular backbones (SASRec and Caser) demonstrate the accuracy, efficiency, and adaptivity of CHORD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。