arXiv:2512.13903cs.RO2025-12被引 1

基于流模型的实时人机协作动作预测框架,提升真实性和交互感知能力。

PrediFlow: A Flow-Based Prediction-Refinement Framework for Real-Time Human Motion Prediction in Human-Robot Collaboration

  • 用流匹配结构融合人机运动信息,迭代优化初始预测
  • 在桌面拆卸数据集上精度显著提升,保持多模态不确定性
  • 满足实时性要求,适合工业人机协作场景

随机性人类动作预测对工业再制造中的人机协作(HRC)安全与高效至关重要,因其能捕捉动作不确定性与多模态行为,而确定性方法无法处理。早期工作注重预测多样性,但常生成不切实际的动作;近期方法关注精度与实时性,但仍可进一步提升预测质量且不超时。此外,现有研究通常将人类动作独立建模,忽略机器人动作对人类行为的影响。为弥补这些不足并实现实时、真实、交互感知的人类动作预测,我们提出一种新颖的预测-精炼框架,通过融合人类与机器人的观测动作,对预训练的先进预测器输出进行精炼。精炼模块采用流匹配结构以建模不确定性。在HRC桌面拆卸数据集上的实验表明,该方法显著提升预测精度,同时保持动作的不确定性和多模态特性。此外,整体推理时间始终在时延预算内,验证了方法的有效性与实用性。

原文摘要 · Abstract (English)

Stochastic human motion prediction is critical for safe and effective human-robot collaboration (HRC) in industrial remanufacturing, as it captures human motion uncertainties and multi-modal behaviors that deterministic methods cannot handle. While earlier works emphasize highly diverse predictions, they often generate unrealistic human motions. More recent methods focus on accuracy and real-time performance, yet there remains potential to improve prediction quality further without exceeding time budgets. Additionally, current research on stochastic human motion prediction in HRC typically considers human motion in isolation, neglecting the influence of robot motion on human behavior. To address these research gaps and enable real-time, realistic, and interaction-aware human motion prediction, we propose a novel prediction-refinement framework that integrates both human and robot observed motion to refine the initial predictions produced by a pretrained state-of-the-art predictor. The refinement module employs a Flow Matching structure to account for uncertainty. Experimental studies on the HRC desktop disassembly dataset demonstrate that our method significantly improves prediction accuracy while preserving the uncertainties and multi-modalities of human motion. Moreover, the total inference time of the proposed framework remains within the time budget, highlighting the effectiveness and practicality of our approach.

人机协作动作预测流模型实时性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。