让机器人学会抓握和梳理各种发型,通用性强且能零样本迁移。
DYMO-Hair: Generalizable Volumetric Dynamics Modeling for Robot Hair Manipulation
- 基于隐空间编辑的动态建模,支持复杂发丝形变学习。
- 在未见过发型上实现22%更低几何误差、42%更高成功率。
- 真实世界中成功操作假发,超越现有系统表现。
梳理头发是日常必需活动,但对行动受限人群和自主机器人而言仍具挑战,源于发丝精细结构与复杂动力学。本文提出DYMO-Hair,一种基于模型的机器人护发系统。引入针对发丝等体素量的新动态学习范式,结合动作条件隐状态编辑机制与大规模预训练的3D发型隐空间,提升对未见发型的泛化能力。该隐空间通过新型头发物理模拟器预训练,使模型可适应多样发型。配合模型预测路径积分(MPPI)规划器,实现视觉目标引导的发型造型。仿真实验表明,该动态模型在捕捉多样化未见发型局部形变方面优于基线。闭环造型任务中,平均几何误差降低22%,成功率提升42%,超越当前最优系统。真实世界实验显示,系统可零样本迁移至假发,在复杂未见发型上保持稳定成功,而当前最优系统失败。结果为基于模型的机器人护发奠定基础,推动在非受限物理环境中更通用、灵活、可及的机器人造型发展。
原文摘要 · Abstract (English)
Hair care is an essential daily activity, yet it remains inaccessible to individuals with limited mobility and challenging for autonomous robot systems due to the fine-grained physical structure and complex dynamics of hair. In this work, we present DYMO-Hair, a model-based robot hair care system. We introduce a novel dynamics learning paradigm that is suited for volumetric quantities such as hair, relying on an action-conditioned latent state editing mechanism, coupled with a compact 3D latent space of diverse hairstyles to improve generalizability. This latent space is pre-trained at scale using a novel hair physics simulator, enabling generalization across previously unseen hairstyles. Using the dynamics model with a Model Predictive Path Integral (MPPI) planner, DYMO-Hair is able to perform visual goal-conditioned hair styling. Experiments in simulation demonstrate that DYMO-Hair's dynamics model outperforms baselines on capturing local deformation for diverse, unseen hairstyles. DYMO-Hair further outperforms baselines in closed-loop hair styling tasks on unseen hairstyles, with an average of 22% lower final geometric error and 42% higher success rate than the state-of-the-art system. Real-world experiments exhibit zero-shot transferability of our system to wigs, achieving consistent success on challenging unseen hairstyles where the state-of-the-art system fails. Together, these results introduce a foundation for model-based robot hair care, advancing toward more generalizable, flexible, and accessible robot hair styling in unconstrained physical environments. More details are available on our project page: https://dymohair.github.io/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。