arXiv:2601.13665cs.CV2026-01

用融合模型同时识别蔬菜、检测变质、预测保质期,减少食物浪费。

Transformer based Multi-task Fusion Network for Food Spoilage Detection and Shelf life Forecasting

  • 结合CNN、LSTM与DeiT Transformer,实现多任务协同分析。
  • 保质期预测误差低至MSE 3.58,SMAPE 41.66%,分类准确率F1达0.98。
  • 适用于农业供应链管理,对图像噪声有鲁棒性,可解释性强。

食物浪费是农业供应链中的关键挑战,准确高效的变质检测有助于降低浪费。进一步预测变质信息对延长供应链管理周期至关重要。为此,我们提出一种融合架构,结合CNN、LSTM与DeiT Transformer,同时完成三项任务:(i)蔬菜分类,(ii)食品变质检测,(iii)保质期预测。通过采集蔬菜从新鲜状态到完全腐败的图像,构建了新数据集。实验表明,所提融合模型CNN+CNN-LSTM和CNN+DeiT Transformer优于CNN、VGG16、ResNet50、胶囊网络及DeiT Transformer等模型。其中,CNN+DeiT Transformer在蔬菜分类中取得0.98的F1-score,变质检测F1-score为0.61,保质期预测的均方误差(MSE)为3.58,对称平均绝对百分比误差(SMAPE)为41.66%。此外,融合模型在含噪图像上表现稳定,并通过LIME可视化决策过程,验证其可靠性。

原文摘要 · Abstract (English)

Food wastage is one of the critical challenges in the agricultural supply chain, and accurate and effective spoilage detection can help to reduce it. Further, it is highly important to forecast the spoilage information. This aids the longevity of the supply chain management in the agriculture field. This motivated us to propose fusion based architectures by combining CNN with LSTM and DeiT transformer for the following multi-tasks simultaneously: (i) vegetable classification, (ii) food spoilage detection, and (iii) shelf life forecasting. We developed a dataset by capturing images of vegetables from their fresh state until they were completely spoiled. From the experimental analysis it is concluded that the proposed fusion architectures CNN+CNN-LSTM and CNN+DeiT Transformer outperformed several deep learning models such as CNN, VGG16, ResNet50, Capsule Networks, and DeiT Transformers. Overall, CNN + DeiT Transformer yielded F1-score of 0.98 and 0.61 in vegetable classification and spoilage detection respectively and mean squared error (MSE) and symmetric mean absolute percentage error (SMAPE) of 3.58, and 41.66% respectively in spoilage forecasting. Further, the reliability of the fusion models was validated on noisy images and integrated with LIME to visualize the model decisions.

食物变质多任务学习视觉预测Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。