arXiv:2608.02477cs.IR2026-08

不依赖配对数据的生成式推荐,统一处理图文信息。

Unpaired Modality-Agnostic Generative Recommendation

论文配图:Unpaired Modality-Agnostic Generative Recommendation
图 1 · 摘自论文原文
  • 用统一语义空间融合图文数据,无需配对样本
  • 在三个数据集上均优于现有方法,支持不完整观测
  • 适合多模态数据缺失场景的推荐系统

生成式推荐将推荐任务建模为对离散语义标识符(ID)的自回归生成。尽管近期多模态生成式推荐方法利用视觉和文本信息改进语义ID构建,但通常需要项目级配对观测,导致分词仅限于模态共现区域。此外,引入未配对观测非常困难,因为微小表示偏移可能跨越量化边界,产生不兼容的标识符序列。为此,我们提出无配对模态无关生成式推荐(UnpairGR),从配对、仅图像、仅文本观测中学习统一的语义ID空间。UnpairGR将模态特异性处理限制在轻量输入投影中,后续Transformer与残差代码本对所有观测条件共享。配对观测建立可靠性引导的跨模态共识,单模态观测则直接优化相同表示与代码。学习到的分词器固定后,作为单一自回归推荐器的稳定目标,无需特征补全、模态专用代码本或回退映射。在三个基准数据集上的大量实验表明,UnpairGR在完全观测和不完整观测设置下均持续提升推荐性能。

原文摘要 · Abstract (English)

Generative Recommendation (GR) formulates recommendation as autoregressive generation over discrete semantic identifiers (IDs). Although recent multimodal GR methods improve semantic ID construction with visual and textual information, they typically require item-level paired observations, restricting tokenization to the intersection of modality availability. Moreover, incorporating unpaired observations is nontrivial because small representation shifts may cross quantization boundaries and produce incompatible identifier sequences. To address this challenge, we propose \textbf{Unpair}ed Modality-Agnostic \textbf{G}enerative \textbf{R}ecommendation (UnpairGR), which learns a unified semantic-ID space from paired, image-only, and text-only observations. UnpairGR confines modality-specific processing to lightweight input projections while sharing the subsequent Transformer and residual codebooks across all observation conditions. Paired observations establish a reliability-guided cross-modal consensus, whereas unimodal observations directly refine the same representations and codes. The learned tokenizer is then fixed to provide stationary targets for a single autoregressive recommender, without feature imputation, modality-specific codebooks, or fallback mappings. Extensive experiments on three benchmark datasets demonstrate that UnpairGR consistently improves recommendation performance under both fully observed and incomplete-observation settings.

生成式推荐多模态无配对数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。