跨平台电商商品分类,用多模态融合提升准确率并发现新细分类别。
Cross-Platform E-Commerce Product Categorization and Recategorization: A Multimodal Hierarchical Classification Approach
- 融合文本、图像与视觉语言特征,采用MLP晚融合策略提升分类性能。
- 在40个平台27万商品上实现98.59%的层级F1,发现纯度超86%的新子类。
- 适合需要跨平台统一分类的电商平台和商品智能系统开发者。
本研究针对电商商品分类中的平台异构性与现有分类体系结构局限性,提出一种多模态层次化分类框架。基于来自40个国际时尚电商平台的271,700件商品数据集,整合了文本特征(RoBERTa)、视觉特征(ViT)以及联合视觉-语言表示(CLIP)。在层次化架构中探索早期、晚期及注意力融合策略,并引入动态掩码机制保障分类体系一致性。结果显示,通过MLP驱动的晚融合策略结合CLIP嵌入,达到最高的层级F1(98.59%),优于单模态基线。为解决分类过浅或不一致问题,进一步提出基于SimCLR、UMAP与级联聚类的自监督“商品再分类”流程,发现了多个细粒度类别(如“鞋类”子类),聚类纯度高于86%。跨平台实验揭示部署权衡:复杂晚融合方法在多样训练数据下精度最高,而简单早融合更具跨平台泛化能力。最终,通过两阶段推理管道在EURWEB商业交易智能平台成功部署,结合轻量级RoBERTa与GPU加速多模态模块,在成本与精度间取得平衡。
原文摘要 · Abstract (English)
This study addresses critical industrial challenges in e-commerce product categorization, namely platform heterogeneity and the structural limitations of existing taxonomies, by developing and deploying a multimodal hierarchical classification framework. Using a dataset of 271,700 products from 40 international fashion e-commerce platforms, we integrate textual features (RoBERTa), visual features (ViT), and joint vision-language representations (CLIP). We investigate fusion strategies, including early, late, and attention-based fusion within a hierarchical architecture enhanced by dynamic masking to ensure taxonomic consistency. Results show that CLIP embeddings combined via an MLP-based late-fusion strategy achieve the highest hierarchical F1 (98.59%), outperforming unimodal baselines. To address shallow or inconsistent categories, we further introduce a self-supervised "product recategorization" pipeline using SimCLR, UMAP, and cascade clustering, which discovered new, fine-grained categories (for example, subtypes of "Shoes") with cluster purities above 86%. Cross-platform experiments reveal a deployment-relevant trade-off: complex late-fusion methods maximize accuracy with diverse training data, while simpler early-fusion methods generalize more effectively to unseen platforms. Finally, we demonstrate the framework's industrial scalability through deployment in EURWEB's commercial transaction intelligence platform via a two-stage inference pipeline, combining a lightweight RoBERTa stage with a GPU-accelerated multimodal stage to balance cost and accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。