通过网页结构识别电商中相似但不同的商品关系,提升推荐与搜索体验。
Learning variant product relationship and variation attributes from e-commerce website structures
- 结合编码与生成式AI,从网页链接中挖掘商品变体关系。
- 在头部电商平台数据上验证,匹配准确率显著优于传统方法。
- 适合做商品推荐、搜索优化和用户画像的工程师与研究员。
我们提出VARM(变体关系匹配策略),用于识别电商目录中的商品变体对。传统实体消歧关注产品提及是否指向同一商品,但无法捕捉电商应用中关键的商品关联,如同一页面上展示的相似但不完全相同商品或共享评价的商品。为此,我们提出一种新型实体消歧:不仅判断两个商品是否为变体匹配,还需识别其差异属性。为此,我们构建了包含网页商品链接的数据集,训练一个编码型大模型以预测任意商品对是否为变体匹配;同时,利用RAG提示的生成型大模型,从变体商品组中提取差异与共性属性。我们在全球领先电商平台的真实数据上评估该策略,结果表明其性能优于现有方案,为挖掘此类新型商品关系提供了有效路径。
原文摘要 · Abstract (English)
We introduce VARM, variant relationship matcher strategy, to identify pairs of variant products in e-commerce catalogs. Traditional definitions of entity resolution are concerned with whether product mentions refer to the same underlying product. However, this fails to capture product relationships that are critical for e-commerce applications, such as having similar, but not identical, products listed on the same webpage or share reviews. Here, we formulate a new type of entity resolution in variant product relationships to capture these similar e-commerce product links. In contrast with the traditional definition, the new definition requires both identifying if two products are variant matches of each other and what are the attributes that vary between them. To satisfy these two requirements, we developed a strategy that leverages the strengths of both encoding and generative AI models. First, we construct a dataset that captures webpage product links, and therefore variant product relationships, to train an encoding LLM to predict variant matches for any given pair of products. Second, we use RAG prompted generative LLMs to extract variation and common attributes amongst groups of variant products. To validate our strategy, we evaluated model performance using real data from one of the world's leading e-commerce retailers. The results showed that our strategy outperforms alternative solutions and paves the way to exploiting these new type of product relationships.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。