用手机拍照估算孟加拉街头小吃热量,准确率超95%。
Vision-Based Calorie Estimation for Bangladeshi Street Food: A Comparative Study of Detection and Regression Models
- 用硬币当标尺测食物大小,结合目标检测模型识别菜品。
- 随机森林回归预测热量,误差仅5.68大卡,准确率达95%。
- 专为孟加拉街头美食设计,适合健康监测类应用开发。
随着肥胖成为全球重大健康问题,精准的热量估算系统对饮食管理至关重要。现有基于视觉的方法多针对西方餐饮,难以适用于广泛消费且具有文化意义的孟加拉街头食品,常忽略分量大小。本研究提出一种专为孟加拉街头食品设计的视觉热量估算方法。基于自建数据集(3,885张图片,6个类别:Singara、Somusa、Puri、Peaju、Beguni和以5塔卡硬币为参考),对比了五种检测与分割模型:YOLOv8n、YOLO11n、YOLO12n、YOLO26n和RF-DETR。以5塔卡硬币作为尺度参考,校准食物尺寸。提取几何特征后输入随机森林、梯度提升与AdaBoost等回归模型进行热量预测。结果显示,YOLO11n在检测任务中表现最佳,达到96.1% mAP@50及平衡的掩码指标;随机森林回归取得最优效果,平均绝对误差(MAE)为5.68,均方根误差(RMSE)为7.23,决定系数(R2)达95.0%。该组合可实现高精度、高效的孟加拉街头食品热量估算,适用于饮食监控与移动健康应用。代码与数据集已公开于https://github.com/hossain-tamim/BD-CAL。
原文摘要 · Abstract (English)
With obesity emerging as a major global health concern, accurate calorie estimation systems have become increasingly important for effective dietary management. Current vision-based approaches are inappropriate for Bangladeshi street food, which is widely consumed and culturally significant, because they mostly focus on Western cuisines and often overlook portion size. The purpose of this research is to offer a vision-based calorie estimation methodology that was created especially for street food in Bangladesh. Training, validation and testing splits were created from a proprietary dataset of 3,885 photos from six classes (Singara, Somusa, Puri, Peaju, Beguni, and Coin as a reference). Five detection and segmentation architectures, YOLOv8n, YOLO11n, YOLO12n, YOLO26n and RF-DETR, were methodically compared. Food dimensions were scaled using a Bangladeshi 5 Taka coin as a reference. To predict calories, extracted geometric characteristics were subsequently fed into machine learning regression models such as Random Forest, Gradient Boost and AdaBoost. YOLO11n outperformed other models with the best detection performance, achieving 96.1% mAP@50 and balanced mask metrics. With a mean absolute error (MAE) of 5.68, root mean squared error (RMSE) of 7.23, and an R2 score of 95.0%, Random Forest regression produced the best results for calorie estimation. YOLO11n in conjunction with Random Forest regression offers a precise and effective calorie estimation for street food in Bangladesh, which is useful for dietary monitoring and mobile health apps. The code and dataset are publicly available on https://github.com/hossain-tamim/BD-CAL .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。