用大模型智能整合多种上下文信息,提升电视内容推荐精准度。
An LLM-powered Agentic Recommendation System for Connected TV Content Discovery

- 构建基于大模型的智能代理系统,自动处理多源异构信息。
- 在保持高效推理的同时,显著提升推荐个性化与上下文感知能力。
- 适合追求高灵活性与实时性推荐系统的研发团队参考。
推荐系统在融合趋势话题、突发新闻、文化事件及跨平台用户行为等多样化上下文信号时面临挑战。传统系统依赖结构化行为数据,缺乏自然处理非结构化或格式不一信息的能力,通常需人工特征工程和定制数据管道。本文提出一种面向连网电视(CTV)内容发现的大型语言模型驱动的智能代理推荐系统,利用大模型的推理能力,无需手动集成即可自然融合不同格式的信号。针对当前大模型在检索效率、个性化精度和可扩展性方面仍不及传统机器学习模型的问题,采用智能体架构,由最适配的方法处理各子任务(大模型或传统机器学习)。核心贡献在于工程实践上克服了大模型应用于推荐中的实际瓶颈,特别是推理延迟问题。文中分享了构建混合系统的经验,探讨了性能与灵活性之间的权衡与教训。
原文摘要 · Abstract (English)
Recommendation systems, from traditional multi-stage to recent unified generative architectures, face challenges in incorporating diverse contextual signals, such as trending topics, breaking news, cultural events, and cross-surface user activities, into their ranking pipelines. These systems are designed to consume structured behavioral signals with consistent schemas, and lack the reasoning capability to naturally process unstructured or heterogeneously formatted contextual information. Incorporating such signals typically requires feature engineering, bespoke data pipelines, and carefully tuned heuristics. In this paper, we present an LLM-powered agentic recommendation system designed for Connected TV (CTV) content discovery that addresses these limitations. Our system leverages the reasoning capabilities of large language models to naturally process and synthesize diverse signals across varying schemas and structures, eliminating much of the manual integration inherent in traditional ranking and retrieval systems. Recognizing that current LLM-based solutions still fall short of traditional machine learning models in several recommendation tasks, including retrieval efficiency, personalization precision, and scalability, we adopt an agentic architecture that orchestrates specialized components, allowing each sub-task to be handled by the most suitable method, whether LLM-based or traditional ML. The main contribution of this work is our engineering approach to successfully overcoming the practical limitations of enabling LLM for recommendation, particularly inference latency. We share insights from our work and discuss the trade-offs and lessons learned in building a hybrid system that combines the flexibility of LLMs with the performance of established recommendation techniques.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。