用用户点击点赞等行为数据,让图像生成更懂个人喜好。
Personalized Image Generation for Recommendations Beyond Catalogs
- 通过用户行为信号训练条件扩散模型生成个性化图像嵌入
- 在真实数据集上生成图像质量高,且比基线方法更贴合用户偏好
- 无需微调主模型,适合大规模个性化推荐场景
个性化是人机交互的核心,但现有基于扩散模型的图像生成系统对用户差异响应有限。现有方法常依赖昂贵的配对偏好数据或引入大语言模型导致延迟。本文提出 REBECA(REcommendations BEyond CAtalogs),一种轻量级可扩展的个性化图像生成框架,直接从用户的点击、点赞、评分等隐式反馈中学习。不微调底层扩散模型,而是采用两阶段流程:先训练一个条件扩散模型生成用户与评分相关的图像嵌入,再用预训练扩散主干解码成图像。该方法实现无微调的大规模个性化。我们在真实数据集上进行严格评估,提出新的统计个性化验证器和置换假设检验以衡量偏好一致性。结果表明,REBECA持续生成高质量、符合个体审美的图像,在保持计算高效的同时优于基线方法。
原文摘要 · Abstract (English)
Personalization is central to human-AI interaction, yet current diffusion-based image generation systems remain largely insensitive to user diversity. Existing attempts to address this often rely on costly paired preference data or introduce latency through Large Language Models. In this work, we introduce REBECA (REcommendations BEyond CAtalogs), a lightweight and scalable framework for personalized image generation that learns directly from implicit feedback signals such as likes, ratings, and clicks. Instead of fine-tuning the underlying diffusion model, REBECA employs a two-stage process: training a conditional diffusion model to sample user- and rating-specific image embeddings, which are subsequently decoded into images using a pretrained diffusion backbone. This approach enables efficient, fine-tuning-free personalization across large user bases. We rigorously evaluate REBECA on real-world datasets, proposing a novel statistical personalization verifier and a permutation-based hypothesis test to assess preference alignment. Our results demonstrate that REBECA consistently produces high-fidelity images tailored to individual tastes, outperforming baselines while maintaining computational efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。