arXiv:2605.17489cs.CV2026-05

用现成的视觉语言模型实现可解释的面部图像质量评估

Employing Vision-Language Models for Face Image Quality Assessment

论文配图:Employing Vision-Language Models for Face Image Quality Assessment
图 1 · 摘自论文原文
  • 直接使用预训练视觉语言模型进行零样本面部质量评分
  • 大模型未必更好,小模型反而在缺陷检测上表现更优
  • 输出可解释,适合需要人工审核的生物识别场景

面部图像质量评估(FIQA)是生物识别流程中的关键环节,确保仅可靠样本被处理以维持系统准确性。现有顶尖方法虽性能优异,但通常为“黑箱”运行,仅输出数值评分而无可解释理由,限制了其在自动边境管控等需人工干预场景的应用。本文探索现成视觉语言模型(VLMs)在零样本条件下执行FIQA的潜力。构建了全面的评估框架,通过误判率-拒收率曲线对比传统方法,并基于涵盖监控与合成数据的多样化数据集,分析其可解释性、一致性及对提示变化的鲁棒性。结果表明,生物识别效用表现显著依赖架构而非参数量;多数VLM输出与传统方法一致。同时发现,不同提示下排名和分数可能变化。合成消融实验显示,参数量增加虽提升内部一致性,却导致更差的退化检测性能。研究证明,利用VLM进行零样本FIQA评分前景广阔,可作为传统管道的可解释性补充模块。代码已开源。

原文摘要 · Abstract (English)

Face Image Quality Assessment (FIQA) is a crucial control step in biometric pipelines. It ensures only reliable samples are processed to maintain system accuracy. State-of-the-art FIQA methods achieve high utility but typically operate as "black boxes." They produce scalar scores without human-interpretable justifications. This lack of transparency limits their effectiveness in human-in-the-loop scenarios, such as automated border control, where actionable feedback is essential. In this paper, we investigate the potential of off-the-shelf Vision-Language Models (VLMs) to bridge this gap by performing FIQA in a zero-shot setting. We present a comprehensive evaluation framework for assessing VLM performance. This involves benchmarking traditional FIQA methods through error-versus-reject curves. Additionally, using a diverse set of datasets, ranging from surveillance-oriented to synthetically generated, we analyzed their interpretability, consistency, and robustness to prompt changes. Our results show biometric utility performance depends significantly on architecture, not merely on parameter count. Most VLMs' outputs align with those of traditional methods. We also find that VLM ranking performance and the generated scores may vary across prompts. Our synthetic ablation study shows that while increasing the parameter count can improve internal consistency, it yields worse degradation-detection performance than smaller models. These findings suggest that zero-shot FIQA score estimation using VLMs is promising and could effectively complement conventional FIQA pipelines as an interpretability module. The codes are available at https://github.com/ThEnded32/VLM4FIQA.git.

图像质量评估视觉语言模型可解释性生物识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。