推荐系统从原始ID走向语义规划,实现更智能的规模化信息利用。
From Raw IDs to Semantic Planning: How Recommender Systems Utilize Information at Scale
- 用语义ID替代原始ID,结构化表达物品信息以支持模型理解
- 当前系统已将内容、上下文等信息封装进语义标识,提升推荐精度
- 未来或转向先规划语义目标再生成具体项目,适合平台级系统设计者
推荐系统的演进可从其如何规模化利用信息来考察。过去二十年中,工业系统主要依赖原始ID——离散、全局唯一且语义不透明的标识符,能实现大规模精确查找、日志记录和物品记忆。但随着发展,系统开始整合更丰富的信息源,包括物品内容、上下文、多模态信号及跨域结构。这促使一种新阶段:部分信息不再仅作为物品身份的辅助特征,而是逐步被封装进语义ID,形成更结构化、面向模型的标识形式。本文认为,这一转变超越了生成式推荐对传统方法的替代,反映了在工业规模约束下,推荐系统对信息利用方式的根本演变。本文探讨三个核心问题:为何原始ID曾主导早期系统;为何如今语义信息正被嵌入ID;以及当推荐超越语义检索后可能的发展方向。特别提出‘语义规划’作为未来方向——系统先预测下一次曝光的语义目标,再将其具象为具体物品或生成内容。我们进一步指出,这种转变不仅需要模型架构革新,也需评估范式与用户、平台、供给方目标协调机制的重构。
原文摘要 · Abstract (English)
The evolution of recommender systems can be explored by asking how they utilize information at scale. Throughout most of the historical period under consideration during the past two decades, industrial systems have relied on raw IDs, which are discrete, globally unique, and semantically opaque identifiers that enable exact lookup, logging, and item-specific memorization at scale. Over time, however, recommender systems have sought to utilize richer sources of information, including item content, context, multimodal signals, and cross-domain structure. This development has led to a new stage in which part of such information is no longer used solely as auxiliary features around item identity, but is increasingly encapsulated in semantic IDs that provide a more structured, model-facing form of identity. We argue that this shift goes beyond the rise of generative recommendation over traditional methods. Indeed, it reflects a broader evolution in how recommender systems utilize information under industrial-scale constraints. This paper looks at the past, present, and future to examine three connected questions: why raw IDs dominated the early development of recommender systems, why semantic information is increasingly being encapsulated in IDs today, and what may come next once recommendations move beyond semantic retrieval. In particular, we introduce semantic planning as a possible future direction in which the system first predicts the semantic target of the next exposure, and only then instantiates that target as a specific item or generated creative. We further argue that such a shift may require changes not only in model design but also in evaluation and in the way recommender systems coordinate the objectives of users, platforms, and providers.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。