融合深度与传统特征,用降维提升表情识别准确率
Hy-Facial: Hybrid Feature Extraction by Dimensionality Reduction Methods for Enhanced Facial Expression Classification
- 结合VGG19、SIFT和ORB提取多源特征
- 采用UMAP降维后达83.3%识别准确率
- 适合图像特征工程与降维研究者参考
面部表情分类因图像数据高维度和内在复杂性仍具挑战。本文提出Hy-Facial框架,融合深度学习与传统图像处理技术,并系统评估降维策略。方法结合VGG19深层特征、手工设计的局部描述符以及SIFT与ORB算法,生成丰富多样的图像表征。为缓解特征冗余并降低计算复杂度,全面评估多种降维技术,发现UMAP在保持高维特征空间的局部与全局结构方面最优。该流程整合VGG19、SIFT与ORB进行特征提取,经K-means聚类与UMAP降维后,在面部表情识别(FER)数据集上达到83.3%的分类准确率。结果表明,降维不仅是预处理步骤,更是提升特征质量与整体性能的关键环节。
原文摘要 · Abstract (English)
Facial expression classification remains a challenging task due to the high dimensionality and inherent complexity of facial image data. This paper presents Hy-Facial, a hybrid feature extraction framework that integrates both deep learning and traditional image processing techniques, complemented by a systematic investigation of dimensionality reduction strategies. The proposed method fuses deep features extracted from the Visual Geometry Group 19-layer network (VGG19) with handcrafted local descriptors and the scale-invariant feature transform (SIFT) and Oriented FAST and Rotated BRIEF (ORB) algorithms, to obtain rich and diverse image representations. To mitigate feature redundancy and reduce computational complexity, we conduct a comprehensive evaluation of dimensionality reduction techniques and feature extraction. Among these, UMAP is identified as the most effective, preserving both local and global structures of the high-dimensional feature space. The Hy-Facial pipeline integrated VGG19, SIFT, and ORB for feature extraction, followed by K-means clustering and UMAP for dimensionality reduction, resulting in a classification accuracy of 83. 3\% in the facial expression recognition (FER) dataset. These findings underscore the pivotal role of dimensionality reduction not only as a pre-processing step but as an essential component in improving feature quality and overall classification performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。