arXiv:2601.17492cs.IR2026-01中稿 · WWW 2026被引 3

不重训大模型,快速消除推荐系统偏见。

Towards Fair Large Language Model-based Recommender Systems without Costly Retraining

  • 将去偏转化为机器遗忘任务,分两阶段识别并移除偏见样本。
  • 在多个数据集上提升公平性,准确率损失小于1.5%。
  • 无需重训,适合实际部署的推荐系统优化。

大语言模型(LLM)通过生成式用户建模革新了推荐系统,但其常无意继承训练数据中的偏见,导致严重公平性问题。现有去偏方法面临两大挑战:一是针对特定偏见类型,难以应对真实场景中多样或新出现的偏见;二是依赖重训的方法在超大规模参数模型下计算成本过高。为此,我们提出 FUDLR(Fast Unified Debiasing for LLM-RS),核心思路是将去偏问题重构为高效机器遗忘任务,包含两个阶段:首先,通过一种无偏见感知掩码识别需遗忘的偏见样本,该设计可灵活适配不同公平性度量;其次,通过估计并移除这些样本对模型参数的影响实现高效去偏。大量实验表明,FUDLR 在保持推荐准确率的同时显著提升公平性,在多个基准数据集上公平性指标平均提升超过20%,且准确率下降低于1.5%。代码与数据已公开于 https://github.com/JinLi-i/FUDLR。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have revolutionized Recommender Systems (RS) through advanced generative user modeling. However, LLM-based RS (LLM-RS) often inadvertently perpetuates bias present in the training data, leading to severe fairness issues. Addressing these fairness problems in LLM-RS faces two significant challenges. 1) Existing debiasing methods, designed for specific bias types, lack the generality to handle diverse or emerging biases in real-world applications. 2) Debiasing methods relying on retraining are computationally infeasible given the massive parameter scale of LLMs. To overcome these challenges, we propose FUDLR (Fast Unified Debiasing for LLM-RS). The core idea is to reformulate the debiasing problem as an efficient machine unlearning task with two stages. First, FUDLR identifies bias-inducing samples to unlearn through a novel bias-agnostic mask, optimized to balance fairness improvement with accuracy preservation. Its bias-agnostic design allows adaptability to various or co-existing biases simply by incorporating different fairness metrics. Second, FUDLR performs efficient debiasing by estimating and removing the influence of identified samples on model parameters. Extensive experiments demonstrate that FUDLR effectively and efficiently improves fairness while preserving recommendation accuracy, offering a practical path toward socially responsible LLM-RS. The code and data are available at https://github.com/JinLi-i/FUDLR.

推荐系统大模型公平性去偏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。