用AI视觉智能管理冰箱,减少食物浪费并优化购物计划。
A smart fridge with AI-enabled food computing
- 通过摄像头与算法实时识别食材,自动追踪库存。
- 在多层重叠场景下仍能保持90%以上识别准确率。
- 适合关注环保、想省事的家庭用户使用。
物联网(IoT)在智能家居中对食品管理至关重要。本研究结合物联网与计算机视觉,采用ESP32-CAM构建监控子系统,实现食材实时检测、库存追踪与温度监测,提升食品管理效率,助力减废、优化采购与消费行为。高密度存储时,部分遮挡或堆叠图像导致目标检测困难,视角多样与细节模糊降低算法可靠性,常引发误检或漏检。为此,系统设计三模块:数据预处理、目标检测与管理、基于Web的可视化。针对模型过自信预测导致校准偏差问题,提出一种改进型焦点损失,引入温度缩放实现类别自适应误差校准,并评估预测概率分布。实验表明,该方法显著提升复杂光照与可扩展性条件下的检测可靠性。结果验证了该系统在实际应用中的可行性,推动可持续生活,实现减废与理性消费。
原文摘要 · Abstract (English)
The Internet of Things (IoT) plays a crucial role in enabling seamless connectivity and intelligent home automation, particularly in food management. By integrating IoT with computer vision, the smart fridge employs an ESP32-CAM to establish a monitoring subsystem that enhances food management efficiency through real-time food detection, inventory tracking, and temperature monitoring. This benefits waste reduction, grocery planning improvement, and household consumption optimization. In high-density inventory conditions, capturing partial or layered images complicates object detection, as overlapping items and occluded views hinder accurate identification and counting. Besides, varied angles and obscured details in multi-layered setups reduce algorithm reliability, often resulting in miscounts or misclassifications. Our proposed system is structured into three core modules: data pre-processing, object detection and management, and a web-based visualization. To address the challenge of poor model calibration caused by overconfident predictions, we implement a variant of focal loss that mitigates over-confidence and under-confidence in multi-category classification. This approach incorporates adaptive, class-wise error calibration via temperature scaling and evaluates the distribution of predicted probabilities across methods. Our results demonstrate that robust functional calibration significantly improves detection reliability under varying lighting conditions and scalability challenges. Further analysis demonstrates a practical, user-focused approach to modern food management, advancing sustainable living goals through reduced waste and more informed consumption.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。