arXiv:2511.05292cs.CVcs.LG2025-11

用可穿戴设备识别吃啥菜,不拍照也不靠回忆。

What's on Your Plate? Inferring Chinese Cuisine Intake from Wearable IMUs

  • 结合手表手部动作与眼镜头部动态识食
  • 在11类中餐上分类准确率高,27.5小时数据验证
  • 适合饮食监测、慢病管理人群使用

精准的食物摄入检测对饮食监控和慢性病预防至关重要。传统自述方法易受回忆偏差影响,基于摄像头的方法则引发隐私担忧。现有可穿戴方法多局限于汉堡、披萨等少数食物类型,难以应对中式菜肴的多样性。为此,我们提出CuisineSense系统,通过智能手表捕捉手部运动特征,结合智能眼镜获取头部动态,实现中式菜肴分类。为过滤日常活动干扰,设计两阶段检测流程:第一阶段识别进食状态,区分进食与非进食行为的时序特征;第二阶段基于进食过程中的运动信号进行细粒度食物分类。为评估系统性能,构建包含11类食物、10名参与者、总计27.5小时的IMU数据集。实验表明,CuisineSense在进食状态检测与食物分类任务中均表现优异,提供了一种无侵入式、可穿戴的饮食监控解决方案。系统代码已公开于https://github.com/joeeeeyin/CuisineSense.git。

原文摘要 · Abstract (English)

Accurate food intake detection is vital for dietary monitoring and chronic disease prevention. Traditional self-report methods are prone to recall bias, while camera-based approaches raise concerns about privacy. Furthermore, existing wearable-based methods primarily focus on a limited number of food types, such as hamburgers and pizza, failing to address the vast diversity of Chinese cuisine. To bridge this gap, we propose CuisineSense, a system that classifies Chinese food types by integrating hand motion cues from a smartwatch with head dynamics from smart glasses. To filter out irrelevant daily activities, we design a two-stage detection pipeline. The first stage identifies eating states by distinguishing characteristic temporal patterns from non-eating behaviors. The second stage then conducts fine-grained food type recognition based on the motions captured during food intake. To evaluate CuisineSense, we construct a dataset comprising 27.5 hours of IMU recordings across 11 food categories and 10 participants. Experiments demonstrate that CuisineSense achieves high accuracy in both eating state detection and food classification, offering a practical solution for unobtrusive, wearable-based dietary monitoring.The system code is publicly available at https://github.com/joeeeeyin/CuisineSense.git.

饮食监测可穿戴设备中文菜肴姿态识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。