解决大模型推荐中的倾向性偏差问题,提升推荐公平性与准确性。
Mitigating Propensity Bias of Large Language Models for Recommender Systems
- 通过谱编码器将历史交互结构信息融入侧信息表示
- 利用反事实推理有效缓解大模型带来的推荐偏差
- 适用于需要公平性与真实偏好捕捉的推荐场景
大语言模型(LLM)的发展为推荐系统带来了新机遇,尤其可通过模型生成的物品描述等侧信息增强推荐。然而,将这些侧信息与历史交互的协同信息对齐面临挑战。大模型固有的偏差会扭曲推荐结果,导致不公平的用户体验。此外,倾向性偏差会使侧信息被压缩到低维子空间,引发维度坍缩,严重削弱推荐系统捕捉用户偏好的能力。为此,本文提出一种名为反事实大模型推荐(CLLMR)的新框架。具体地,设计了一种基于谱的侧信息编码器,隐式将历史交互的结构信息嵌入侧信息表示中,从而避免维度坍缩。同时,通过反事实推理挖掘推荐系统中的因果关系,抵消大模型引入的偏差。大量实验表明,CLLMR在多种推荐模型上均能持续提升性能。
原文摘要 · Abstract (English)
The rapid development of Large Language Models (LLMs) creates new opportunities for recommender systems, especially by exploiting the side information (e.g., descriptions and analyses of items) generated by these models. However, aligning this side information with collaborative information from historical interactions poses significant challenges. The inherent biases within LLMs can skew recommendations, resulting in distorted and potentially unfair user experiences. On the other hand, propensity bias causes side information to be aligned in such a way that it often tends to represent all inputs in a low-dimensional subspace, leading to a phenomenon known as dimensional collapse, which severely restricts the recommender system's ability to capture user preferences and behaviours. To address these issues, we introduce a novel framework named Counterfactual LLM Recommendation (CLLMR). Specifically, we propose a spectrum-based side information encoder that implicitly embeds structural information from historical interactions into the side information representation, thereby circumventing the risk of dimension collapse. Furthermore, our CLLMR approach explores the causal relationships inherent in LLM-based recommender systems. By leveraging counterfactual inference, we counteract the biases introduced by LLMs. Extensive experiments demonstrate that our CLLMR approach consistently enhances the performance of various recommender models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。