arXiv:2608.18258cs.RO2026-08

用虚拟现实采集人类示范,训练机器人精准舀取颗粒状食物。

VERAGMIL: Virtual Environment for Scooping Granular Foods with Imitation Learning Models

论文配图:VERAGMIL: Virtual Environment for Scooping Granular Foods with Imitation Learning Models
图 1 · 摘自论文原文
  • 通过虚拟现实界面采集人类操作示范,提升数据质量。
  • 基于虚拟示范训练的模型在防洒漏、成功率上接近人类水平。
  • 适合研究康复机器人、具身智能与模仿学习的团队使用。

机器人辅助进食(RAF)系统对帮助残障或运动障碍者完成进餐至关重要。但处理如米饭、豆类等颗粒状食物时,因其动态物理特性带来显著挑战。从人类示范中学习是一种有前景的解决方案,但高质量示范的获取复杂。为此,我们提出VERAGMIL框架,结合高保真仿真器与直观的虚拟现实(VR)界面,用于记录示范并支持多种模仿学习方法。VERAGMIL提供逼真的训练环境,包含机器人、传感器及具有不同物理特性的多种食物。我们评估了三种模仿学习模型(BC、BC-RNN、BCQ)在颗粒舀取与运输任务中的表现,对比了由VR界面和3D空间鼠标采集的示范数据,并以人类专家为基准。评估指标包括成功率、溢出率、对未见食物的泛化能力及任务完成时间。结果表明,基于VR的示范显著优于3D空间鼠标数据,其中BCQ模型整体表现最佳,尤其在减少溢出方面接近人类水平。这些发现证明了该框架在颗粒物料处理训练中的有效性。代码已公开:https://github.com/AmanuelErgogo/VERAGMIL.git。

原文摘要 · Abstract (English)

Robot-Assisted Feeding (RAF) systems are essential for assisting individuals with disabilities or motor impairments in eating tasks. Manipulating granular food items, such as rice and beans, poses significant challenges due to their dynamic physical properties. Learning from human demonstrations offers a promising solution, but acquiring high-quality demonstrations is complex. To address this, we present VERAGMIL, a framework that combines a high-fidelity simulator with an intuitive Virtual Reality (VR) interface for recording demonstrations and supporting different imitation learning methods. VERAGMIL provides a realistic environment for training RAF systems to handle granular materials, including robots, sensors, and various food items with distinct physical characteristics. We evaluate VERAGMIL by training three imitation learning models, BC, BC-RNN, and BCQ, on granular scooping and transporting tasks using both VR interface and 3D space mouse demonstrations, comparing them with a human-expert baseline. The models are assessed on success rate, spillage, generalization to unseen food items, and task completion time. Results show that VR-based demonstrations significantly outperform 3D space mouse data, with BCQ achieving the best overall performance, particularly in reducing spillage and approaching human performance. These findings underscore the effectiveness of our framework for training RAF systems in granular material handling. The code for our framework is publicly available at: https://github.com/AmanuelErgogo/VERAGMIL.git.

机器人进食虚拟现实模仿学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。