arXiv:2412.01747cs.CV2024-12被引 1

用事件相机实现高精度连续时间人体运动建模

Continuous-Time Human Motion Field from Events

  • 通过隐式时间函数构建连续人体运动场,替代传统离散帧预测
  • 在新数据集上相比之前方法关节误差降低23.8%,计算耗时减少69%
  • 适合需要高帧率、低延迟人体动作估计的实时系统

本文针对从事件流中估计连续时间人体运动场的挑战提出新方法。现有基于帧的人体网格重建(HMR)方法受限于有限的时间分辨率和运动模糊,易产生混叠与误差。本文利用递归前馈神经网络,在可能的人体运动潜在空间中直接预测连续时间人体运动场。相比以往依赖高帧率下固定姿态优化的事件基方法,本工作首次将离散时间预测替换为时间隐式函数表示,支持任意时间分辨率的并行姿态查询。尽管事件相机潜力巨大,但极少有基准测试其在高速人体运动估计中的极限。为此,我们引入Beam-splitter Event Agile Human Motion Dataset——一个硬件同步的高速人体数据集。在该数据集上,本方法相比先前事件人体方法提升关节误差23.8%,同时计算时间减少69%。

原文摘要 · Abstract (English)

This paper addresses the challenges of estimating a continuous-time human motion field from a stream of events. Existing Human Mesh Recovery (HMR) methods rely predominantly on frame-based approaches, which are prone to aliasing and inaccuracies due to limited temporal resolution and motion blur. In this work, we predict a continuous-time human motion field directly from events by leveraging a recurrent feed-forward neural network to predict human motion in the latent space of possible human motions. Prior state-of-the-art event-based methods rely on computationally intensive optimization across a fixed number of poses at high frame rates, which becomes prohibitively expensive as we increase the temporal resolution. In comparison, we present the first work that replaces traditional discrete-time predictions with a continuous human motion field represented as a time-implicit function, enabling parallel pose queries at arbitrary temporal resolutions. Despite the promises of event cameras, few benchmarks have tested the limit of high-speed human motion estimation. We introduce Beam-splitter Event Agile Human Motion Dataset-a hardware-synchronized high-speed human dataset to fill this gap. On this new data, our method improves joint errors by 23.8% compared to previous event human methods while reducing the computational time by 69%.

事件相机连续时间人体运动估计高帧率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。