用多模态大模型帮个人卖家自动生成商品描述,提升电商发布质量。
IPL: Leveraging Multimodal Large Language Models for Intelligent Product Listing

- 通过上传商品照片,自动提取属性生成描述
- 在闲鱼平台风格上微调模型,减少幻觉问题
- 已上线生产环境,72%用户使用生成内容,质量提升5.6%
与专业B2C电商平台(如Amazon)不同,个人对个人(C2C)平台(如闲鱼)的卖家多为缺乏电商经验的个体。他们常难以撰写合适的商品描述。随着多模态大语言模型(MLLMs)的发展,我们提出IPL——一种面向商品发布的智能生成工具,基于类别、品牌、颜色、成色等属性,仅需上传商品图片即可生成描述。更重要的是,IPL能模仿闲鱼平台的内容风格,通过领域特定指令微调和多模态检索增强生成(RAG)实现。实证评估显示,IPL所用模型在特定任务中显著优于基线模型,且幻觉更少。该系统已成功部署于生产环境:72%的用户使用生成内容发布商品,其商品质量评分比未使用AI的高出5.6%。
原文摘要 · Abstract (English)
Unlike professional Business-to-Consumer (B2C) e-commerce platforms (e.g., Amazon), Consumer-to-Consumer (C2C) platforms (e.g., Facebook marketplace) are mainly targeting individual sellers who usually lack sufficient experience in e-commerce. Individual sellers often struggle to compose proper descriptions for selling products. With the recent advancement of Multimodal Large Language Models (MLLMs), we attempt to integrate such state-of-the-art generative AI technologies into the product listing process. To this end, we develop IPL, an Intelligent Product Listing tool tailored to generate descriptions using various product attributes such as category, brand, color, condition, etc. IPL enables users to compose product descriptions by merely uploading photos of the selling product. More importantly, it can imitate the content style of our C2C platform Xianyu. This is achieved by employing domain-specific instruction tuning on MLLMs and adopting the multi-modal Retrieval-Augmented Generation (RAG) process. A comprehensive empirical evaluation demonstrates that the underlying model of IPL significantly outperforms the base model in domain-specific tasks while producing less hallucination. IPL has been successfully deployed in our production system, where 72% of users have their published product listings based on the generated content, and those product listings are shown to have a quality score 5.6% higher than those without AI assistance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。