发现并缓解大模型推荐中的刻板印象不公平问题
Investigating and Mitigating Stereotype-aware Unfairness in LLM-based Recommendations
- 设计多刻板专家路由机制,学习去偏文本表征
- 实验证明新方法在多种公平性设置下优于基线
- 适合关注AI推荐公平性的研究者与开发者
大型语言模型(LLMs)在理解语言和推理方面表现出色,能捕捉多样化的用户偏好并推动个性化推荐。然而,与传统推荐系统中用户/物品的独立表征不同,基于LLM的推荐系统中用户和物品共享文本表征(如词嵌入)。由于训练数据广泛且未经筛选,LLM可能继承嵌入在词嵌入中的普遍刻板印象,导致推荐系统在用户与物品间产生刻板语言关联,引发双向(用户到物品)推荐不公平。本文揭示了一种新型的公平性问题——同时涉及用户和物品群体的刻板印象歧视,并提出名为混合刻板印象(Mixture-of-Stereotypes, MoS)的新框架以缓解该问题。通过设计一种基于刻板印象的专家路由策略,模型可针对不同刻板印象学习无偏表征。大量实验表明,该方法在多种公平性设定下均显著优于现有基准。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have demonstrated unprecedented language understanding and reasoning capabilities to capture diverse user preferences and advance personalized recommendations. Despite the growing interest in LLM-based recommendations, unique challenges are brought to the trustworthiness of LLM-based recommender systems (LLM-RS). Compared to unique user/item representations in conventional recommender systems, users and items share the textual representation (e.g., word embeddings) in LLM-based recommendations. Recent studies have revealed that LLMs are likely to inherit stereotypes that are embedded ubiquitously in word embeddings, due to their training on large-scale uncurated datasets. This leads to LLM-RS exhibiting stereotypical linguistic associations between users and items, causing a form of two-sided (i.e., user-to-item) recommendation fairness. However, there remains a lack of studies investigating the unfairness of LLM-RS due to intrinsic stereotypes, which can simultaneously involve user and item groups. To bridge this gap, this study reveals a new variant of fairness between stereotype groups containing both users and items, to quantify discrimination against stereotypes in LLM-RS. Moreover, in this paper, to mitigate stereotype-aware unfairness in textual user and item representations, we propose a novel framework named Mixture-of-Stereotypes (MoS). In particular, an insightful stereotype-wise routing strategy over multiple stereotype-relevant experts is designed, aiming to learn unbiased representations against different stereotypes in LLM-RS. Extensive experiments are conducted to analyze the influence of stereotype-aware fairness in LLM-RS and the effectiveness of our proposed methods, which consistently outperform competitive benchmarks under various fairness settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。