用超图建模表情数据关系,提升联邦学习下个性化表情识别的准确率。
Uncertainty-Aware Label Refinement on Hypergraphs for Personalized Federated Facial Expression Recognition
- 通过超图捕捉表情样本间的高阶关联,增强不确定性估计。
- 在两个真实数据库上性能优于现有方法,提升显著。
- 适合隐私敏感场景下的个性化人脸表情识别应用。
大多数表情识别模型依赖大规模集中式数据训练,但因面部图像涉及隐私,实际收集困难。本文在个性化联邦学习框架下研究表情识别,提出一种不确定性感知的超图标签精炼方法(AMY)。每个客户端模型包含主干网络、不确定性估计(UE)模块和表情分类(EC)模块。在UE模块中,利用超图建模表情样本间的复杂高阶关系,并融入不确定性特征;引入个性化不确定性估计器,计算本地样本的可靠权重。在EC模块中,基于超图进行标签传播,获得高质量精炼标签以重训练分类器。该方法有效缓解了客户端间异构样本的不确定性,使各客户端均能学习到鲁棒的个性化表情识别模型。在两个挑战性真实世界表情数据库上的实验表明,所提方法持续优于多个先进方法,验证了超图建模在不确定性估计与标签精炼中的优势。代码将公开于 https://github.com/mobei1006/AMY。
原文摘要 · Abstract (English)
Most facial expression recognition (FER) models are trained on large-scale expression data with centralized learning. Unfortunately, collecting a large amount of centralized expression data is difficult in practice due to privacy concerns of facial images. In this paper, we investigate FER under the framework of personalized federated learning, which is a valuable and practical decentralized setting for real-world applications. To this end, we develop a novel uncertainty-Aware label refineMent on hYpergraphs (AMY) method. For local training, each local model consists of a backbone, an uncertainty estimation (UE) block, and an expression classification (EC) block. In the UE block, we leverage a hypergraph to model complex high-order relationships between expression samples and incorporate these relationships into uncertainty features. A personalized uncertainty estimator is then introduced to estimate reliable uncertainty weights of samples in the local client. In the EC block, we perform label propagation on the hypergraph, obtaining high-quality refined labels for retraining an expression classifier. Based on the above, we effectively alleviate heterogeneous sample uncertainty across clients and learn a robust personalized FER model in each client. Experimental results on two challenging real-world facial expression databases show that our proposed method consistently outperforms several state-of-the-art methods. This indicates the superiority of hypergraph modeling for uncertainty estimation and label refinement on the personalized federated FER task. The source code will be released at https://github.com/mobei1006/AMY.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。