arXiv:2507.18429cs.CVcs.LG2025-07被引 1

用流形学习解决小数据下的头部姿态估计,精度高且实时。

NLML-HPE: Head Pose Estimation with Limited Data via Manifold Learning

  • 将姿态估计转为回归问题,用张量分解建模旋转流形
  • 在自动生成的精确2D数据集上训练,提升标注可靠性
  • 仅需少量数据即可实现高精度实时预测,适合资源受限场景

头部姿态估计在人机交互、人脸识别等计算机视觉应用中至关重要。本文提出一种基于非线性流形学习的深度学习方法NLML-HPE,适用于有限训练数据场景。该方法结合张量分解(即塔克分解)与前馈神经网络,将姿态估计建模为回归问题,将输入面部关键点映射到连续的姿态角表示。通过张量分解将每个欧拉角(偏航、俯仰、翻滚)分解至独立子空间,并将每个流形维度建模为余弦曲线。针对两大挑战:1)几乎所有HPE数据集存在标注不准确问题,因此我们通过固定姿态旋转3D头模型并渲染生成了精确一致的2D头姿数据集;2)在有限数据下实现了实时性能,因模型能准确捕捉物体旋转的本质。一旦各轴旋转流形被学习,对未见数据的预测速度极快。训练与测试代码及训练好的模型已公开:https://github.com/MahdiGhafoorian/NLML_HPE。

原文摘要 · Abstract (English)

Head pose estimation (HPE) plays a critical role in various computer vision applications such as human-computer interaction and facial recognition. In this paper, we propose a novel deep learning approach for head pose estimation with limited training data via non-linear manifold learning called NLML-HPE. This method is based on the combination of tensor decomposition (i.e., Tucker decomposition) and feed forward neural networks. Unlike traditional classification-based approaches, our method formulates head pose estimation as a regression problem, mapping input landmarks into a continuous representation of pose angles. To this end, our method uses tensor decomposition to split each Euler angle (yaw, pitch, roll) to separate subspaces and models each dimension of the underlying manifold as a cosine curve. We address two key challenges: 1. Almost all HPE datasets suffer from incorrect and inaccurate pose annotations. Hence, we generated a precise and consistent 2D head pose dataset for our training set by rotating 3D head models for a fixed set of poses and rendering the corresponding 2D images. 2. We achieved real-time performance with limited training data as our method accurately captures the nature of rotation of an object from facial landmarks. Once the underlying manifold for rotation around each axis is learned, the model is very fast in predicting unseen data. Our training and testing code is available online along with our trained models: https: //github.com/MahdiGhafoorian/NLML_HPE.

姿态估计小样本学习流形学习3D重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。