arXiv:2605.27950cs.CV2026-05

用可穿戴相机拍的进食照片,能判断人改变饮食习惯的意愿吗?

Evaluating the Feasibility of Inferring Dietary Behavior Change Receptivity from Egocentric Images of Eating Environment

论文配图:Evaluating the Feasibility of Inferring Dietary Behavior Change Receptivity from Egocentric Images of Eating Environment
图 1 · 摘自论文原文
  • 用预训练视觉模型分析佩戴式相机拍的进食图像序列
  • 对行为改变意愿的三个维度预测准确率优于基础模型
  • 为实时干预提供新思路,适合健康科技研究者参考

精准评估饮食行为改变意愿对于设计有效的即时适应性干预(JITAI)至关重要。然而,依赖自我报告的评估方式存在数据稀疏和延迟问题,难以支持持续监测。本研究探索通过被动感知解决该挑战,基于自动摄入监测仪v2(AIM-2)在自由生活状态下收集的佩戴式进食图像,结合参与者对行为改变意愿(意识、互动能力、动机)的自评问答,检验视觉信息与意愿之间的相关性。采用结合CLIP视觉编码器与轻量级Transformer分类器的迁移学习框架,分析进食过程图像序列中潜在的语义与时间线索。初步实验结果表明,该模型在行为改变意愿指标上显著优于简单基线模型。早期发现提示,佩戴式进食图像可能蕴含与饮食行为改变意愿相关的线索,值得在更大更全面的数据集上进一步研究。

原文摘要 · Abstract (English)

Accurately assessing dietary behavior change receptivity is essential for designing effective just-in-time adaptive interventions (JITAIs) that promote healthier eating habits. However, self-report-based assessment of behavior change receptivity is sparse and delayed, limiting its practical use in continuous monitoring. To explore whether passive sensing may help address this challenge, this study conducts a pilot investigation of inferring participants' self-reported behavior change receptivity from egocentric eating images collected by a wearable camera. We use pilot data obtained from free-living eating episodes using the Automatic Ingestion Monitor v2 (AIM-2). The data included egocentric image sequences captured during eating and paired with responses to questions assessing specific dimensions of behavior change receptivity (awareness, interaction capability, and motivation). To examine whether visual information contained any relevancy to these responses, we evaluated a transfer-learning-assisted framework that combines a pre-trained Contrastive Language-Image Pre-Training (CLIP) vision encoder with a lightweight transformer classifier. The model processes eating episode image sequences to extract potential semantic and temporal cues related to behavior change receptivity. Preliminary experimental results show promising improvements over simple baseline models for behavior change receptivity indicators. These early findings suggest that egocentric eating episode images may contain cues related to dietary behavior change receptivity, and warrant further investigation with larger and more comprehensive datasets.

行为评估可穿戴设备视觉分析健康干预

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。