arXiv:2508.20534cs.CV2025-08AAAI

用手机拍照估算体重指数,精度达业内最高,且支持手机端实时运行。

Digital Scale: Open-Source On-Device BMI Estimation from Smartphone Camera Images Trained on a Large-Scale Real-World Dataset

  • 基于8.5万张真实手机拍摄图,自动过滤低质图像提升数据质量
  • 在自建数据集上实现7.9%的平均误差率,为当前最优
  • 模型开源并部署于安卓设备,适合医疗、应急等场景快速筛查

通过机器学习从摄像头图像中估算体质量指数(BMI),可在远程医疗或紧急情况下实现快速体重评估。现有视觉方法受限于最多14,500张图像的数据集。本研究提出一种基于深度学习的BMI估算方法,训练数据来自我们自有的WayBED数据集,包含25,353名个体的84,963张智能手机图像。我们设计了一种自动筛选方法,结合姿态聚类与人体检测,剔除姿势异常或视图不全的低质量图像,最终保留71,322张高质量图像用于训练。在独立测试集(WayBED)上,使用全身图像实现7.9%的平均绝对百分比误差(MAPE),为目前文献报道最低值。在完全未见过的VisualBodyToBMI数据集上,未微调模型即达到13%的MAPE,表现接近现有最优方法;进一步在该数据集微调后,实现8.56%的MAPE,为该数据集当前最低记录。我们采用CLAID框架将完整流程(图像过滤+BMI预测)部署至Android设备,并开源全部代码,包括模型训练、数据过滤及移动端部署包。

原文摘要 · Abstract (English)

Estimating Body Mass Index (BMI) from camera images with machine learning models enables rapid weight assessment when traditional methods are unavailable or impractical, such as in telehealth or emergency scenarios. Existing computer vision approaches have been limited to datasets of up to 14,500 images. In this study, we present a deep learning-based BMI estimation method trained on our WayBED dataset, a large proprietary collection of 84,963 smartphone images from 25,353 individuals. We introduce an automatic filtering method that uses posture clustering and person detection to curate the dataset by removing low-quality images, such as those with atypical postures or incomplete views. This process retained 71,322 high-quality images suitable for training. We achieve a Mean Absolute Percentage Error (MAPE) of 7.9% on our hold-out test set (WayBED data) using full-body images, the lowest value in the published literature to the best of our knowledge. Further, we achieve a MAPE of 13% on the completely unseen~(during training) VisualBodyToBMI dataset, comparable with state-of-the-art approaches trained on it, demonstrating robust generalization. Lastly, we fine-tune our model on VisualBodyToBMI and achieve a MAPE of 8.56%, the lowest reported value on this dataset so far. We deploy the full pipeline, including image filtering and BMI estimation, on Android devices using the CLAID framework. We release our complete code for model training, filtering, and the CLAID package for mobile deployment as open-source contributions.

BMI估算手机端推理开源模型真实世界数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。