arXiv:2606.02021cs.CV2026-06

通过精准重建食物三维模型,实现吃每一口的体积精确估算。

PerBite: A Curated Diagnostic Workflow for Bite-Aware Food Volume Estimation

论文配图:PerBite: A Curated Diagnostic Workflow for Bite-Aware Food Volume Estimation
图 1 · 摘自论文原文
  • 用分割+三维重建+板子校准,逐口还原食物形态与体积。
  • 平均体积误差仅33.87%,且无吞咽逻辑错误,表现领先。
  • 适合做饮食监测、临床营养评估的研究者参考。

视觉上逼真的食物三维网格是否可信用于食量估计?本方法基于MetaFood CVPR 2026连续进食三维重建挑战中的配对前后状态数据,提出一种经筛选的重建流程:使用SAM~3分割食物与餐盘区域;Hunyuan3D/SAM~3D生成无尺度食物网格;以餐盘直径提供度量尺度;在Blender中移除餐盘几何;修补孔洞、确保网格闭合,并整合计算体积。当直接测量餐盘尺寸困难时,仅用MoGe-2作为初始直径估计的辅助线索,不作为主要尺度来源。该方法在34个网格上以刚性ICP无尺度校正获得8.31的平均切比雪夫距离,对17对前后状态实现33.87%的状态级体积平均绝对百分比误差(MAPE),零单调性违规,消耗体积MAPE为53.74%。结果表明,表面重建、度量尺度、网格清理、闭合体积积分与物理耗尽一致性应分别评估,以提升饮食评估可靠性。源代码与评估脚本将公开于github.com/GCVCG/PerBite-CVPR-MetaFood-2026。

原文摘要 · Abstract (English)

Can a visually plausible food mesh be trusted to estimate the volume of consumed food? \method investigates this question using selected paired before- and after-consumption states from the MetaFood CVPR 2026 Continuous 3D Reconstruction While Eating Challenge. The submitted workflow follows a curated reconstruction protocol: SAM~3 segments the food and plate regions; Hunyuan3D/SAM~3D generates a dimensionless food mesh; the plate diameter provides the metric scale; the plate geometry is removed in Blender; and the remaining mesh is hole-filled, made watertight, and integrated to estimate volume. MoGe-2 is used only as an auxiliary cue for initial dish-diameter estimation when direct plate measurement is uncertain; it is not the primary scale source for the reported challenge result. \method ranks first, with an average Chamfer distance of 8.31 across 34 meshes using rigid ICP without scale correction. On 17 before- and after-pairs, it achieves 33.87\% state-level volume MAPE and zero monotonicity violations, while consumed-volume MAPE remains 53.74\%. The results show that surface reconstruction, metric scale, controlled mesh cleanup, watertight volume integration, and physical depletion consistency should be evaluated separately for dietary assessment. Source code and evaluation scripts will be available at \href{https://github.com/GCVCG/PerBite-CVPR-MetaFood-2026}{github.com/GCVCG/PerBite-CVPR-MetaFood-2026}.

食物体积三维重建饮食评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。