提出双层优化框架BiFair,同时缓解大模型推荐中的生成与训练不公平。
BiFair: A Fairness-aware Training Framework for LLM-enhanced Recommender Systems via Bi-level Optimization
- 通过双层优化分别调整大模型生成的特征和推荐模型投影参数。
- 在三个真实数据集上显著降低推荐不公平性,优于现有最先进方法。
- 适合关注推荐系统公平性的研究者与工业界从业者。
大型语言模型增强的推荐系统(LLM-enhanced RSs)通过利用大模型生成物品表示来提升推荐质量,但其集成也带来严重的公平性问题。现有研究表明,基于大模型的推荐系统比传统系统更具不公平性,而该类系统的公平性问题仍缺乏深入探索。本文实证研究发现,尽管大模型推荐系统在物品组间提升了公平性,但仍存在显著的公平性差距。进一步优化困难源于架构差异及不公平来源多样。为此,我们首次将不公平性分解为大模型生成表示中的先验不公平性与推荐模型训练中的训练不公平性。进而提出BiFair,一种基于双层优化的公平性感知训练框架,可同时缓解两类不公平。BiFair通过嵌套双层优化过程,学习调整大模型生成表示与推荐模型中可训练投影器的参数。此外,引入自适应组间平衡机制,基于多目标优化原理动态平衡不同物品组间的公平性。在三个真实世界数据集上的大量实验表明,BiFair能显著缓解不公平性,且优于先前最先进方法。
原文摘要 · Abstract (English)
Large Language Model-enhanced Recommender Systems (LLM-enhanced RSs) have emerged as a powerful approach to improving recommendation quality by leveraging LLMs to generate item representations. Despite these advancements, the integration of LLMs raises severe fairness concerns. Existing studies reveal that LLM-based RSs exhibit greater unfairness than traditional RSs, yet fairness issues in LLM-enhanced RSs remain largely unexplored. In this paper, our empirical study reveals that while LLM-enhanced RSs improve fairness across item groups, a significant fairness gap persists. Further enhancement remains challenging due to the architectural differences and varying sources of unfairness inherent in LLM-enhanced RSs. To bridge this gap, we first decompose unfairness into i) \textit{prior unfairness} in LLM-generated representations and ii) \textit{training unfairness} in recommendation models. Then, we propose BiFair, a bi-level optimization-based fairness-aware training framework designed to mitigate both prior and training unfairness simultaneously. BiFair optimizes two sets of learnable parameters: LLM-generated representations and a trainable projector in the recommendation model, using a two-level nested optimization process. Additionally, we introduce an adaptive inter-group balancing mechanism, leveraging multi-objective optimization principles to dynamically balance fairness across item groups. Extensive experiments on three real-world datasets demonstrate that BiFair significantly mitigates unfairness and outperforms previous state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。