提出无需重配的推荐系统框架,让模型一键适配新数据和任务。
Universal Reusability in Recommender Systems: The Case for Dataset- and Task-Independent Frameworks
- 用标准化语言描述数据与任务,自动完成特征工程与模型选择。
- 实现从依赖数据/任务的系统到完全独立系统的跃迁,提升复用率。
- 适合想快速部署推荐系统的开发者,降低技术门槛。
推荐系统在各行业提供个性化体验至关重要,但其应用与扩展受限于对特定数据集和任务的大量配置需求。现有系统通常需大量人工干预、领域知识和工程投入才能适配新数据或新任务,造成进入壁垒并限制复用性。受大语言模型(LLMs)可复用性的启发,我们提出数据集与任务无关的推荐系统(DTIRS),旨在最大化推荐系统的可复用性并降低使用门槛。不同于直接通过模型实现任务泛化的LLMs,DTIRS专注于消除为每个新数据集或任务重新构建或调整推荐流水线的需求,即使模型仍需在新数据上重新训练。通过引入新型数据集描述语言(DsDL),DTIRS实现数据集描述与任务定义的标准化,支持自主特征工程、模型选择与优化。本文提出DTIRS概念,并建立从一级自动化(数据集无关但任务相关)到二级自动化(完全数据集与任务无关)的演进路线图。达成此范式将极大提升代码复用率并降低采用门槛。我们讨论关键挑战,包括泛化与专业化之间的权衡、计算开销与可扩展性,并将DsDL视为实现该愿景的基础工具。
原文摘要 · Abstract (English)
Recommender systems are pivotal in delivering personalized experiences across industries, yet their adoption and scalability remain hindered by the need for extensive dataset- and task-specific configurations. Existing systems often require significant manual intervention, domain expertise, and engineering effort to adapt to new datasets or tasks, creating barriers to entry and limiting reusability. In contrast, recent advancements in large language models (LLMs) have demonstrated the transformative potential of reusable systems, where a single model can handle diverse tasks without significant reconfiguration. Inspired by this paradigm, we propose the Dataset- and Task-Independent Recommender System (DTIRS), a framework aimed at maximizing the reusability of recommender systems while minimizing barriers to entry. Unlike LLMs, which achieve task generalization directly, DTIRS focuses on eliminating the need to rebuild or reconfigure recommendation pipelines for every new dataset or task, even though models may still need retraining on new data. By leveraging the novel Dataset Description Language (DsDL), DTIRS enables standardized dataset descriptions and explicit task definitions, allowing autonomous feature engineering, model selection, and optimization. This paper introduces the concept of DTIRS and establishes a roadmap for transitioning from Level-1 automation (dataset-agnostic but task-specific systems) to Level-2 automation (fully dataset- and task-independent systems). Achieving this paradigm would maximize code reusability and lower barriers to adoption. We discuss key challenges, including the trade-offs between generalization and specialization, computational overhead, and scalability, while presenting DsDL as a foundational tool for this vision.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。