用大模型+主动学习低成本构建高质量互补商品关系数据集。
Knowledge-Augmented Relation Learning for Complementary Recommendation with Large Language Models
- 结合大模型自动标注与主动学习,筛选难样本提升标注效率。
- 在分布外场景下,准确率最高提升37%,分布内提升不足0.5%。
- 适合需要泛化能力的电商推荐系统,尤其应对新商品场景。
互补推荐在电商中通过推荐兼容商品提升用户体验至关重要。准确分类互补关系依赖可靠标签,但标签生成面临两难:基于行为的标签易获取却噪声大;基于功能的标签(FBLs)质量高,但需人工标注成本高,限制模型泛化。为此,我们提出知识增强关系学习框架(KARL),通过将主动学习与大语言模型(LLM)结合,高效低成本地扩展高质量FBL数据集。该方法选择分类器最困惑的样本,利用LLM进行标签扩展。实验表明,在分布外(OOD)场景下,模型准确率最高提升37%;而在分布内(ID)场景下,改进小于0.5%,且持续训练可能降低性能。这一差异源于KARL带来的数据多样性,提示应根据预测上下文(ID或OOD)动态调整采样策略。
原文摘要 · Abstract (English)
Complementary recommendations play a crucial role in e-commerce by enhancing user experience through suggestions of compatible items. Accurate classification of complementary item relationships requires reliable labels, but their creation presents a dilemma. Behavior-based labels are widely used because they can be easily generated from interaction logs; however, they often contain significant noise and lack reliability. While function-based labels (FBLs) provide high-quality definitions of complementary relationships by carefully articulating them based on item functions, their reliance on costly manual annotation severely limits a model's ability to generalize to diverse items. To resolve this trade-off, we propose Knowledge-Augmented Relation Learning (KARL), a framework that strategically fuses active learning with large language models (LLMs). KARL efficiently expands a high-quality FBL dataset at a low cost by selectively sampling data points that the classifier finds the most difficult and uses the label extension of the LLM. Our experiments showed that in out-of-distribution (OOD) settings, an unexplored item feature space, KARL improved the baseline accuracy by up to 37%. In contrast, in in-distribution (ID) settings, the learned item feature space, the improvement was less than 0.5%, with prolonged learning could degrade accuracy. These contrasting results are due to the data diversity driven by KARL's knowledge expansion, suggesting the need for a dynamic sampling strategy that adjusts diversity based on the prediction context (ID or OOD).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。