arXiv:2604.03172cs.CV2026-04被引 1

小模型高精度预测商品质量,无需外部数据

EffiMiniVLM: A Compact Dual-Encoder Regression Framework

  • 用EfficientNet-B0和MiniLM构建轻量双编码器,配合加权Huber损失提升训练效率
  • 仅用20%亚马逊数据训练,参数27.7M,算力6.8 GFLOPs,CES达0.40
  • 比大模型省4-8倍资源,且不依赖外部数据,适合冷启动场景

在用户交互历史缺失的冷启动场景中,基于多模态商品信息预测质量至关重要。现有视觉语言模型通常依赖大架构或大量外部数据,计算成本高。为此,我们提出EffiMiniVLM,一个紧凑的双编码器视觉语言回归框架,集成EfficientNet-B0图像编码器与MiniLM文本编码器,并搭配轻量回归头。为提升训练样本效率,引入基于评分频次的加权Huber损失,增强可靠样本权重,带来稳定性能提升。仅使用亚马逊评论2023数据集的20%进行训练,该模型参数量为27.7M,计算量6.8 GFLOPs,CES得分为0.40,在基准测试中资源消耗最低。尽管规模小,其性能仍媲美更大模型,相比其他前五名方法资源效率提升4至8倍,且是唯一不依赖外部数据的方法。进一步分析表明,将数据量扩展至40%即可超越使用更大模型和数据集的方法,凸显其在紧凑设计下仍具备强可扩展性。

原文摘要 · Abstract (English)

Predicting product quality from multimodal item information is critical in cold-start scenarios, where user interaction history is unavailable and predictions must rely on images and textual metadata. However, existing vision-language models typically depend on large architectures and/or extensive external datasets, resulting in high computational cost. To address this, we propose EffiMiniVLM, a compact dual-encoder vision-language regression framework that integrates an EfficientNet-B0 image encoder and a MiniLM-based text encoder with a lightweight regression head. To improve training sample efficiency, we introduce a weighted Huber loss that leverages rating counts to emphasize more reliable samples, yielding consistent performance gains. Trained using only 20% of the Amazon Reviews 2023 dataset, the proposed model contains 27.7M parameters and requires 6.8 GFLOPs, yet achieves a CES score of 0.40 with the lowest resource cost in the benchmark. Despite its small size, it remains competitive with significantly larger models, achieving comparable performance while being approximately 4x to 8x more resource-efficient than other top-5 methods and being the only approach that does not use external datasets. Further analysis shows that scaling the data to 40% alone allows our model to overtake other methods, which use larger models and datasets, highlighting strong scalability despite the model's compact design.

多模态轻量化冷启动回归

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。