让虚拟手抓握更真实,直接根据用户用力意图控制力度。
ForceGrip: Reference-Free Curriculum Learning for Realistic Grip Force Control in VR Hand Manipulation
- 用随机生成的物体和动作挑战智能体,不依赖固定动作数据。
- 三阶段渐进式学习,实现稳定接触、力控自适应和动态鲁棒性。
- 适合做沉浸式VR交互、游戏或训练系统开发的开发者。
真实的虚拟手部操作是实现沉浸式虚拟现实的关键,但现有方法多依赖运动学或动作捕捉数据集,忽略了接触力和指关节扭矩等物理特性,导致只追求统一紧握而忽视用户实际用力意图。本文提出ForceGrip,一种深度学习代理,可生成符合用户握力意图的真实手部操作动作。不同于模仿预定义动作数据,ForceGrip通过随机化物体形状、手腕动作和触发输入流来生成训练场景,覆盖广泛物理交互。为有效学习复杂任务,采用三阶段课程学习框架:指位定位、意图适配与动态稳定。该策略确保了手物接触稳定、基于用户输入的力控自适应及动态条件下的鲁棒性。此外,引入邻近奖励函数以促进自然手指运动并加速训练收敛。定量与定性评估表明,ForceGrip在力控精度和动作合理性方面优于当前最优方法。演示视频作为补充材料提供,代码开源于https://han-dongheun.github.io/ForceGrip。
原文摘要 · Abstract (English)
Realistic Hand manipulation is a key component of immersive virtual reality (VR), yet existing methods often rely on kinematic approach or motion-capture datasets that omit crucial physical attributes such as contact forces and finger torques. Consequently, these approaches prioritize tight, one-size-fits-all grips rather than reflecting users' intended force levels. We present ForceGrip, a deep learning agent that synthesizes realistic hand manipulation motions, faithfully reflecting the user's grip force intention. Instead of mimicking predefined motion datasets, ForceGrip uses generated training scenarios-randomizing object shapes, wrist movements, and trigger input flows-to challenge the agent with a broad spectrum of physical interactions. To effectively learn from these complex tasks, we employ a three-phase curriculum learning framework comprising Finger Positioning, Intention Adaptation, and Dynamic Stabilization. This progressive strategy ensures stable hand-object contact, adaptive force control based on user inputs, and robust handling under dynamic conditions. Additionally, a proximity reward function enhances natural finger motions and accelerates training convergence. Quantitative and qualitative evaluations reveal ForceGrip's superior force controllability and plausibility compared to state-of-the-art methods. Demo videos are available as supplementary material and the code is provided at https://han-dongheun.github.io/ForceGrip.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。