用对比解码生成统一数据,提升推荐模型性能。
Generative Data Transformation: From Mixed to Unified Data
- 以数据为中心,用对比解码融合跨域信息
- 在多个数据集上超越传统模型中心方法
- 适合想提升推荐系统数据质量的研究者
推荐模型性能与训练数据的质量、数量和相关性密切相关。为应对数据稀疏和冷启动问题,现有研究常引入多个辅助域的数据以丰富目标域信息。然而,固有的领域差异会降低混合数据质量,导致负迁移并削弱模型表现。当前主流的模型中心范式依赖复杂定制架构,难以捕捉跨域间细微的非结构化序列依赖,泛化能力差且计算开销高。为此,本文提出 extsc{Taesar}——一种目标对齐的序列再生数据中心框架,通过对比解码机制将跨域上下文自适应编码至目标域序列中,使标准模型无需复杂融合结构即可学习复杂依赖。实验表明, extsc{Taesar} 在多个数据集上优于模型中心方法,并可泛化至多种序列模型。该方法有效结合了数据与模型中心范式的优点,生成更丰富的训练数据。代码已公开于 https://github.com/USTC-StarTeam/Taesar。
原文摘要 · Abstract (English)
Recommendation model performance is intrinsically tied to the quality, volume, and relevance of their training data. To address common challenges like data sparsity and cold start, recent researchs have leveraged data from multiple auxiliary domains to enrich information within the target domain. However, inherent domain gaps can degrade the quality of mixed-domain data, leading to negative transfer and diminished model performance. Existing prevailing \emph{model-centric} paradigm -- which relies on complex, customized architectures -- struggles to capture the subtle, non-structural sequence dependencies across domains, leading to poor generalization and high demands on computational resources. To address these shortcomings, we propose \textsc{Taesar}, a \emph{data-centric} framework for \textbf{t}arget-\textbf{a}lign\textbf{e}d \textbf{s}equenti\textbf{a}l \textbf{r}egeneration, which employs a contrastive decoding mechanism to adaptively encode cross-domain context into target-domain sequences. It employs contrastive decoding to encode cross-domain context into target sequences, enabling standard models to learn intricate dependencies without complex fusion architectures. Experiments show \textsc{Taesar} outperforms model-centric solutions and generalizes to various sequential models. By generating enriched datasets, \textsc{Taesar} effectively combines the strengths of data- and model-centric paradigms. The code accompanying this paper is available at~ \textcolor{blue}{https://github.com/USTC-StarTeam/Taesar}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。