轻量级人脸识别模型,提升移动端实时识别速度与精度。
FaceLiVTv2: An Improved Hybrid Architecture for Efficient Mobile Face Recognition
- 提出Lite MHLA模块,用线性投影替代多层注意力,减少冗余。
- 在多个数据集上实现22%推理延迟降低,速度比同类模型快30.8%。
- 适合对算力敏感的移动设备部署,兼顾高准确率与低功耗。
轻量级人脸识别在边缘和移动设备部署中愈发重要,需在严苛的延迟、内存与能耗限制下保证可靠准确性。尽管近期混合CNN-Transformer架构提升了全局上下文建模能力,但如何有效平衡识别性能与计算效率仍是开放挑战。本文提出FaceLiVTv2,是先前FaceLiVT架构的改进版本,专为移动端人脸识别中的高效全局-局部特征交互设计。核心为Lite MHLA模块,以多头线性令牌投影与仿射缩放变换替代原有多层次注意力设计,降低冗余同时保持各头表征多样性。进一步将Lite MHLA融入统一的RepMix块,协调局部与全局特征交互,并在嵌入阶段采用全局深度可分离卷积实现自适应空间聚合。实验结果显示,在LFW、CA-LFW、CP-LFW、CFP-FP、AgeDB-30和IJB数据集上,FaceLiVTv2持续优于现有轻量级方法。显著地,其相比FaceLiVTv1将移动端推理延迟降低22%,在移动设备上速度最快提升达30.8%超过GhostFaceNets,且在跨平台下较EdgeFace和KANFace降低20%-41%延迟的同时保持更高识别准确率。结果表明,FaceLiVTv2提供了切实可行且可部署的实时人脸识别解决方案。代码已开源:https://github.com/novendrastywn/FaceLiVT。
原文摘要 · Abstract (English)
Lightweight face recognition is increasingly important for deployment on edge and mobile devices, where strict constraints on latency, memory, and energy consumption must be met alongside reliable accuracy. Although recent hybrid CNN-Transformer architectures have advanced global context modeling, striking an effective balance between recognition performance and computational efficiency remains an open challenge. In this work, we present FaceLiVTv2, an improved version of our FaceLiVT hybrid architecture designed for efficient global--local feature interaction in mobile face recognition. At its core is Lite MHLA, a lightweight global token interaction module that replaces the original multi-layer attention design with multi-head linear token projections and affine rescale transformations, reducing redundancy while preserving representational diversity across heads. We further integrate Lite MHLA into a unified RepMix block that coordinates local and global feature interactions and adopts global depthwise convolution for adaptive spatial aggregation in the embedding stage. Under our experimental setup, results on LFW, CA-LFW, CP-LFW, CFP-FP, AgeDB-30, and IJB show that FaceLiVTv2 consistently improves the accuracy-efficiency trade-off over existing lightweight methods. Notably, FaceLiVTv2 reduces mobile inference latency by 22% relative to FaceLiVTv1, achieves speedups of up to 30.8% over GhostFaceNets on mobile devices, and delivers 20-41% latency improvements over EdgeFace and KANFace across platforms while maintaining higher recognition accuracy. These results demonstrate that FaceLiVTv2 offers a practical and deployable solution for real-time face recognition. Code is available at https://github.com/novendrastywn/FaceLiVT.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。