提出可保证查全率的面部检索框架,应对真实场景下的模糊与失真问题。
A Step Forward Towards Trustworthy Risk-Aware Facial Retrieval (RA-FR)

- 根据查询不确定性动态调整检索集大小,确保在指定风险下包含目标图像
- 在IMFDB上实现5%风险目标,平均检索集仅需约10张图
- 融合图像修复、鲁棒特征提取与可证明的决策规则,适合高可靠性安防场景
在非受限监控环境中进行面部图像检索是一项高风险任务,漏检一个关注对象——哪怕只是一个假阴性——都是不可接受的。尽管在精心构建的基准测试中表现接近完美,现有识别系统在真实世界中的域偏移(如低分辨率、运动模糊、光照不控)下表现不佳(例如SCFace数据集)。为弥合这一可靠性差距,我们提出风险感知面部检索(RA-FR)框架,突破固定Top-k检索,实现自适应检索集生成,在用户指定的风险水平α和置信水平1−δ下保证真值图像被包含。本方法包含三项核心贡献:(1) 通过结合潜空间一致性模型(InterLCM)与DiffBIR的混合盲脸修复技术降低随机不确定性;(2) 利用自监督DINOv1 ViT-B与GGeM池化提取恢复鲁棒的判别性特征;(3) 采用基于霍夫丁不等式的分位数预测,根据查询不确定性动态校准检索集大小。在IMFDB基准上,该方法持续满足5%风险目标,平均检索集大小约为10张图像。通过整合特定领域修复、鲁棒表征学习与可证明的决策规则,RA-FR为监控环境下的面部检索提供了可靠且可审计的流程。代码已开源:https://github.com/MuhammadEmmadSiddiqui/RA-FR。
原文摘要 · Abstract (English)
Facial image retrieval in unconstrained surveillance environments is a high-stakes challenge where missing a subject of interest -- a single false negative -- is simply not an option. Despite near-perfect performance on curated benchmarks, current recognition systems falter under real-world domain shifts such as low resolution, motion blur, and uncontrolled illumination (e.g., SCFace). Addressing this reliability gap, we propose Risk-Aware Facial Retrieval (RA-FR), a framework that moves beyond fixed Top-$k$ retrieval to adaptive set generation, guaranteeing ground truth inclusion within a user-specified risk level ($α$) and confidence level ($1 - δ$). Our approach integrates three core contributions: (1) reducing aleatoric uncertainty via a hybrid blind face restoration technique coupling Latent Consistency Models (InterLCM) and DiffBIR; (2) extracting discriminative, restoration-robust features via self-supervised DINOv1 ViT-B with GGeM pooling; and (3) employing conformal prediction with Hoeffding's inequality to dynamically calibrate retrieval set sizes based on query uncertainty. On the IMFDB benchmark, it consistently satisfies a 5% risk target with an average retrieval set size of approximately 10 images. By unifying domain-specific restoration, robust representation learning, and provable decision rules, RA-FR offers a pipeline that makes facial retrieval in surveillance both reliable and auditable. The code is available at: https://github.com/MuhammadEmmadSiddiqui/RA-FR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。