提出新方法分离语义与协同信号,提升推荐系统性能。
Rethinking Semantic Alignment in LLM-Enhanced Collaborative Filtering: A Spectral Decoupling Approach

- 从谱分析视角发现语义与协同信号依赖不同频段成分。
- 解耦非主成分语义信息后,推荐效果显著优于传统对齐方法。
- 无需额外参数,直接融合分频信号,通用性强且高效。
当前LLM增强推荐普遍将语义表示与协同嵌入对齐至共享空间,但这种对齐如何影响LLM编码信息尚不清晰。本文从谱视角重新审视该问题,发现协同表示受用户-项目同质性影响,以平滑低频成分为主;而语义嵌入包含有用但非主成分的奇异分量。通过分成分评估与训练动态分析,我们发现对齐会逐渐将表示集中于主导协同和主语义子空间,削弱与非主成分语义分量的重叠。控制实验表明,非主成分在对齐下收益不稳定,但通过分组件解耦可稳定提升性能,全预测层级解耦效果最佳。结果表明,对齐无法有效利用互补的非主成分语义信息。为此,我们提出UniSpecRec:在各自空间中进行信号特异性谱过滤,并保留协同与语义表示,最终无交叉对齐地融合预测。大量实验验证其有效性、效率与泛化能力。
原文摘要 · Abstract (English)
Recent advances in LLM-enhanced recommendation commonly align semantic representations with collaborative embeddings in a shared space, yet how alignment affects LLM-encoded information remains unclear. In this work, we revisit LLM-enhanced recommendation from a spectral perspective and show that collaborative and semantic signals benefit from different spectral parts. While collaborative representations are dominated by smooth low-frequency components due to user-item homophily, semantic embeddings contain useful non-principal singular components. Through component-wise evaluation and training-dynamics analysis, we find that alignment increasingly concentrates learned representations in dominant collaborative and principal semantic subspaces, reducing overlap with non-principal semantic components. Controlled comparisons show that non-principal components provide inconsistent gains under alignment but consistently improve performance through component-level decoupling, while full prediction-level decoupling achieves the best overall performance. These results indicate that alignment fails to effectively exploit complementary non-principal semantic information. Motivated by these findings, we propose UniSpecRec (Unifying Spectral Signals for Recommendation), which applies signal-specific spectral filtering while preserving collaborative and semantic representations in their respective spaces. UniSpecRec combines their predictions without cross-space alignment or additional trainable parameters. Extensive experiments demonstrate its effectiveness, efficiency, and generalizability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。