用大模型生成可解释的推荐表示,解决本地服务推荐中的语义混杂问题。
Interpretable Representation via LLM-Driven Generative Disentanglement for Local-Life Service Recommendation

- 通过生成式解耦框架分离地理与语义特征,避免信息混淆。
- 在快手和四方网测试中,AUC提升最高达5.44%,碰撞率降至39.9%。
- 结果可解释性强,适合需要可控、可诊断推荐系统的场景。
尽管大语言模型(LLMs)通过语义ID(SID)建模推动了基于ID的推荐发展,但现有SID生成框架普遍采用单一表示后量化范式,存在两大瓶颈:语义混杂导致地理、品牌、品类等异质属性混合,造成量化过程中的信息丢失、低质量SID及严重碰撞;同时黑箱表示学习缺乏显式属性语义,也无法明确界定SID位置的地理或语义意义,削弱了检索可靠性及生成过程的可诊断性。本文提出面向本地生活服务推荐的可解释表示方法LGRID,采用“编码→解耦→对齐→量化”流程。首先通过联合LLM编码保留跨属性地理-语义依赖,而非独立编码各字段。结构化解耦模块将隐藏状态路由至对齐的地理与语义槽位。协同对齐学习使这些槽位既具备生成可解码性,又支持检索判别性。双流残差量化分别将两路特征离散化为紧凑的、具有显式属性对应关系的SIDs。该设计生成的SIDs位置与实体属性及本地服务语义直接关联。在快手和Foursquare数据集上的实验表明,LGRID持续优于强基线,相对AUC最高提升5.44%。其粗粒度地理字段解码准确率超99%,全量SID碰撞率降至39.9%,相较LGSID的97.0%显著降低。
原文摘要 · Abstract (English)
While large language models (LLMs) have advanced ID-based recommendation through Semantic ID (SID) modeling, existing SID generation frameworks largely follow a single-representation-then-quantization paradigm. This design faces two bottlenecks: semantic entanglement mixes heterogeneous attributes, such as geography, brand, and category, causing information loss during quantization, low-quality SIDs, and severe collisions; moreover, black-box representation learning provides neither explicit attribute semantics nor clear geographic or semantic meanings for SID positions. These limitations weaken both retrieval reliability and the ability to diagnose or control SID generation. We propose Interpretable Representation via LLM-Driven Generative Disentanglement for Local-Life Service Recommendation (LGRID). LGRID introduces a generative disentanglement paradigm through an Encode -> Disentangle -> Align -> Quantize pipeline. It first uses joint LLM encoding to preserve cross-attribute geographic-semantic dependencies, rather than encoding fields independently. A Structured Disentangled Block then routes hidden states into attribute-aligned slots for geographic and semantic factors. Synergistic Alignment Learning makes these slots both generatively decodable and discriminative for retrieval, while Dual-Stream Residual Quantization separately discretizes the two streams into compact SIDs with explicit attribute correspondence. This design yields interpretable SIDs with positions grounded in item attributes and local-service semantics. Experiments on Kuaishou and Foursquare show that LGRID consistently outperforms strong SID baselines, achieving up to a 5.44 percent relative AUC gain. It also achieves over 99 percent attribute-decoding accuracy for coarse geographic fields and reduces the full-SID collision rate to 39.9 percent, compared with 97.0 percent for LGSID.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。