arXiv:2602.09445cs.IR2026-02被引 1

为多模态推荐设计个性化轻量微调方法,让不同用户看到物品的不同重点。

Personalized Parameter-Efficient Fine-Tuning of Foundation Models for Multimodal Recommendation

  • 按用户兴趣分组,每组用独立轻量模块捕捉其关注的物品特征
  • 在多个数据集上提升15.3%(NDCG@20),适配多种轻量微调方法
  • 仅增加1.3%参数量,适合资源受限场景下的个性化推荐

近年来,大量研究将多模态物品元数据融入推荐系统,常通过预训练多模态基础模型编码此类数据。由于这些模型并非为推荐任务训练,近期工作采用参数高效微调(PEFT)进行高效适配。然而,即使使用PEFT,多模态基础模型生成的物品嵌入仍对用户无感知:嵌入未根据用户兴趣进行条件化,尽管不同用户关注物品的不同方面。为此,我们提出PerPEFT,一种面向多模态推荐的个性化参数高效微调策略。具体而言,PerPEFT根据用户兴趣分组,并为每组分配独立的PEFT模块,使每个模块能捕捉对该组购买决策最预测性的细粒度物品特征。我们还引入一种专门的训练技术以增强用户-组别条件化效果。值得注意的是,PerPEFT与现有PEFT方法兼容,可与任意适用于多模态基础模型的PEFT方法结合。大量实验表明,(1) PerPEFT相比最强基线最高提升15.3%(NDCG@20),(2) 在多种PEFT变体中均表现一致增益。即便加入个性化,PEFT仍保持轻量,仅增加基础模型1.3%的参数量。代码与数据集已公开于 https://github.com/kswoo97/PerPEFT。

原文摘要 · Abstract (English)

In recent years, substantial research has integrated multimodal item metadata into recommender systems, often by using pre-trained multimodal foundation models to encode such data. Since these models are not originally trained for recommendation tasks, recent works efficiently adapt them via parameter-efficient fine-tuning (PEFT). However, even with PEFT, item embeddings from multimodal foundation models remain user-blind: item embeddings are not conditioned on user interests, despite the fact that users with diverse interests attend to different item aspects. To address this limitation, we propose PerPEFT, a personalized PEFT strategy for multimodal recommendation. Specifically, PerPEFT groups users by interest and assigns a distinct PEFT module to each group, enabling each module to capture the fine-grained item aspects most predictive of that group`s purchase decisions. We further introduce a specialized training technique that strengthens this user-group conditioning. Notably, PerPEFT is PEFT-agnostic and can be paired with any PEFT method applicable to multimodal foundation models. Through extensive experiments, we show that (1) PerPEFT outperforms the strongest baseline by up to 15.3% (NDCG@20) and (2) delivers consistent gains across diverse PEFT variants. It is noteworthy that, even with personalization, PEFT remains lightweight, adding only 1.3% of the parameter count of the foundation model. We provide our code and datasets at https://github.com/kswoo97/PerPEFT.

多模态推荐轻量微调个性化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。