为打字行为识别设计了直接优化等错误率的新损失函数。
EERLoss: A Novel Loss Function for Training Deep Biometric Models. A Case Study in Keystroke Dynamics
- 提出可微分的EER近似损失,让模型训练更贴近真实评估指标。
- 在超18万用户数据上测试,使错误率相对降低约30%。
- 特别适合高变异性的生物特征识别,如打字动态分析。
深度学习在生物特征验证中的训练通常优化间接目标,导致优化过程与核心评估指标——等错误率(EER)之间存在偏差。本文提出EERLoss:一种可微分、任意精确的EER近似方法,用于训练深度生物特征模型,并可扩展至DET曲线任意工作点的优化。为验证该方法,我们在极具挑战性的行为生物特征模态——打字动态验证上进行实验。该任务具有高类内差异和低类间差异的特点。实验基于大规模KVC-onGoing基准,涵盖超过185,000名用户的多场景数据。消融研究显示,EERLoss优于现有最优损失函数,且收敛速度显著更快,降低了整体训练成本。进一步将原KVC冠军架构用EERLoss重训练,结果表明其性能显著超越原始SOTA,EER相对下降约30%。该结果在复杂、大规模基准上的成功验证了EERLoss作为高变异性生物特征任务的对齐训练目标的有效性。
原文摘要 · Abstract (English)
Deep learning approaches to biometric verification are commonly trained by optimizing indirect objectives, creating a misalignment between the optimization process and the primary evaluation metric, typically the Equal Error Rate (EER). This paper introduces EERLoss: a subdifferentiable, arbitrarily accurate approximation to EER for training deep biometric models. Furthermore, this framework has the potential to be adapted to optimize any specific operating point on the DET curve, enhancing its generalizability. To validate this approach, EERLoss is evaluated on a particularly demanding behavioral biometric modality: keystroke dynamics verification. This task is characterized by its high intra-class and low inter-class variability. Experiments are conducted on the large-scale KVC-onGoing benchmark, incorporating data from over 185,000 subjects across different scenarios. A comprehensive ablation study initially demonstrates the superiority of EERLoss in comparison to existing state-of-the-art loss functions. It also converges substantially faster compared to other losses, reducing the overall training cost. Additionally, a comparison is made between the proposed loss and the KVC-winning architecture by re-training it with EERLoss, demonstrating that the proposed approach significantly outperforms the original SoTA, achieving a relative EER reduction of up to approx. 30\%. This improvement on a challenging, large-scale benchmark validates the effectiveness of EERLoss as a task-aligned training objective specifically suited for high-variance biometric traits.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。