用强化学习让电商商品映射模型私有化部署,又快又准。
EPM-RL: Reinforcement Learning for On-Premise Product Mapping in E-Commerce
- 用强化学习将复杂推理过程压缩成可本地运行的小模型。
- 在真实数据上比纯微调提升准确率,且成本远低于商用API。
- 适合对数据隐私要求高、需大规模部署的企业场景。
商品映射是电商平台价格监控与渠道可见性的核心问题。实际中,卖家常在标题中插入促销词、平台标签和套装描述,导致同一商品出现多种名称。现有基于大模型和多智能体的框架虽提升了鲁棒性与可解释性,但依赖昂贵外部API、重复检索和复杂的推理编排,难以在注重隐私的企业环境中大规模部署。为此,我们提出EPM-RL,一种基于强化学习的本地化电商商品映射框架。核心思想是将高成本的智能体推理过程蒸馏为可训练的内部模型。从标注的配对数据集出发,使用大模型生成的推理路径和人工验证结果,先对小型学生模型进行参数高效微调(PEFT)。随后通过基于代理的奖励机制,利用专门设计的评判模型联合评估输出格式合规性、标签正确性及推理偏好得分,进一步优化模型。初步结果显示,EPM-RL持续优于仅使用PEFT的训练方式,在质量-成本权衡上显著优于商业API基线,同时支持私有化部署和更低的运维成本。这表明强化学习可将高延迟的智能体流水线转变为可扩展、可审查、适用于生产的内建系统。
原文摘要 · Abstract (English)
Product mapping, the task of deciding whether two e-commerce listings refer to the same product, is a core problem for price monitoring and channel visibility. In real marketplaces, however, sellers frequently inject promotional keywords, platform-specific tags, and bundle descriptions into titles, causing the same product to appear under many different names. Recent LLM-based and multi-agent frameworks improve robustness and interpretability on such hard cases, but they often rely on expensive external APIs, repeated retrieval, and complex inference-time orchestration, making large-scale deployment costly and difficult in privacy-sensitive enterprise settings. To address these issues, we present EPM-RL, a reinforcement-learning-based framework for building an accurate and efficient on-premise e-commerce product mapping model. Our central idea is to distill high-cost agentic reasoning into a trainable in-house model. Starting from a curated set of product pairs with LLM-generated rationales and human verification, we first perform parameter-efficient fine-tuning (PEFT) on a small student model using structured reasoning outputs. We then further optimize the model with Reinforcement Learning (RL) using an agent-based reward that jointly evaluates output-format compliance, label correctness, reasoning--preference scores from specially designed judge models. Preliminary results show that EPM-RL consistently improves over PEFT-only training and offers a stronger quality--cost trade-off than commercial API-based baselines, while enabling private deployment and lower operational cost. These findings suggest that reinforcement learning can turn product mapping from a high-latency agentic pipeline into a scalable, inspectable, and production-ready in-house system.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。