轻量级眼神估计模型通过融合全局信息提升精度与速度
Lightweight Gaze Estimation Model Via Fusion Global Information
- 用全局信息融合机制替代多层卷积,降低模型复杂度
- 参数和计算量减少超80%,在多个数据集上误差低于5°
- 收敛速度快于同类模型,训练迭代次数减少超25%
基于深度学习的外观眼神估计方法因其高精度和环境适应性日益流行。然而,现有高精度模型通常依赖深层网络,导致参数量大、训练时间长、收敛慢。针对此问题,本文提出一种新型轻量级眼神估计模型FGI-Net(Fusion Global Information)。该模型将全局信息融入CNN,有效弥补了多层卷积与池化间接获取全局信息的不足,降低了模型复杂度,同时提升了精度与收敛速度。大量实验验证表明,相比最新模型GazeCaps,FGI-Net在MPIIFaceGaze(3.74°)、EyeDiap(5.15°)、Gaze360(10.50°)和RT-Gene(6.02°)数据集上分别实现87.1%和79.1%的参数与浮点运算量(FLOPs)减少;在Gaze360和EyeDiap上达到最优精度时,训练迭代次数比GazeTR分别减少25%和37.5%。
原文摘要 · Abstract (English)
Deep learning-based appearance gaze estimation methods are gaining popularity due to their high accuracy and fewer constraints from the environment. However, existing high-precision models often rely on deeper networks, leading to problems such as large parameters, long training time, and slow convergence. In terms of this issue, this paper proposes a novel lightweight gaze estimation model FGI-Net(Fusion Global Information). The model fuses global information into the CNN, effectively compensating for the need of multi-layer convolution and pooling to indirectly capture global information, while reducing the complexity of the model, improving the model accuracy and convergence speed. To validate the performance of the model, a large number of experiments are conducted, comparing accuracy with existing classical models and lightweight models, comparing convergence speed with models of different architectures, and conducting ablation experiments. Experimental results show that compared with GazeCaps, the latest gaze estimation model, FGI-Net achieves a smaller angle error with 87.1% and 79.1% reduction in parameters and FLOPs, respectively (MPIIFaceGaze is 3.74°, EyeDiap is 5.15°, Gaze360 is 10.50° and RT-Gene is 6.02°). Moreover, compared with different architectural models such as CNN and Transformer, FGI-Net is able to quickly converge to a higher accuracy range with fewer iterations of training, when achieving optimal accuracy on the Gaze360 and EyeDiap datasets, the FGI-Net model has 25% and 37.5% fewer iterations of training compared to GazeTR, respectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。