arXiv:2601.22543cs.IR2026-01

解决云端语义缓存过时问题,让设备端能实时校准推荐结果。

SCaLRec: Semantic Calibration for LLM-enabled Cloud-Device Sequential Recommendation

  • 通过评估缓存语义可靠性,判断是否可继续使用云端生成的用户表征。
  • 设备端在不调用云端大模型情况下,基于最新交互数据动态校准语义向量。
  • 实测在真实数据集上显著提升推荐效果,尤其适用于高延迟或低频云端调用场景。

云-设备协同推荐将计算分布在云端与用户设备之间:云端负责语义用户建模,设备则利用近期交互和云端语义信号实现隐私保护且响应迅速的重排序。当云端部署大语言模型(LLMs)时,语义用户表征可通过捕捉高层次意图提升序列推荐性能。然而,每次请求都通过云端LLM推理重新生成语义表征在实际规模下往往不可行。因此,设备端通常复用缓存的云端语义用户嵌入。我们实证发现存在云端语义陈旧效应:重复使用的嵌入与用户最新行为逐渐脱节,导致排名性能明显下降。现有大多数基于LLM的云-设备推荐系统多依赖按需获取云端语义,要么假设云端低延迟访问,要么每请求重新生成语义嵌入。当无法按请求再生且必须复用缓存语义时,出现两个挑战:(1)判断缓存语义在当前请求中是否仍有效;(2)在无法调用云端大模型、仅依赖缓存语义时维持推荐质量。为填补这一空白,我们提出面向云-设备序列推荐的语义校准方法SCaLRec。首先,估计缓存语义在用户最新交互下的可靠性;其次,设计一个设备端语义校准模块,无需每请求调用云端大模型,即可利用最新交互证据对缓存语义嵌入进行本地调整。在真实世界数据集上的实验表明,当存在云端语义陈旧时,SCaLRec始终优于强基线模型。

原文摘要 · Abstract (English)

Cloud-device collaborative recommendation partitions computation across the cloud and user devices: the cloud provides semantic user modeling, while the device leverages recent interactions and cloud semantic signals for privacy-preserving, responsive reranking. With large language models (LLMs) on the cloud, semantic user representations can improve sequential recommendation by capturing high-level intent. However, regenerating such representations via cloud LLM inference for every request is often infeasible at real-world scale. As a result, on-device reranking commonly reuses a cached cloud semantic user embedding across requests. We empirically identify a cloud semantic staleness effect: reused embeddings become less aligned with the user's latest interactions, leading to measurable ranking degradation. Most existing LLM-enabled cloud-device recommenders are typically designed around on-demand cloud semantics, either by assuming low-latency cloud LLM access or by regenerating semantic embeddings per request. When per-request regeneration is infeasible and cached semantics must be reused, two technical challenges arise: (1) deciding when cached cloud semantics remain useful for on-device reranking, and (2) maintaining ranking quality when the cloud LLM cannot be invoked and only cached semantics are available. To address this gap, we introduce the Semantic Calibration for LLM-enabled Cloud-Device Recommendation (SCaLRec). First, it estimates the reliability of cached semantics under the user's latest interactions. Second, an on-device semantic calibration module is proposed to adjusts the cached semantic embedding on-device using up-to-date interaction evidence, without per-request cloud LLM involvement. Experiments on real-world datasets show that SCaLRec consistently improves recommendation performance over strong baselines under cloud semantic staleness.

推荐系统大模型语义校准边缘计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。