单图检测被遮挡的面部,无需生成补全
Extreme Amodal Face Detection
- 用热力图+渐进式解码器,从局部图像推断完整面部位置
- 在单张图像上实现比生成方法更优的检测精度
- 适合安全监控、隐私保护等需检测隐匿人脸的场景
极端非可视检测旨在推断输入图像中不可见但可在扩展视野内观察到的物体2D位置。与仅部分可见且被遮挡的常规非可视检测不同,该任务关注的是完全超出图像范围的物体。本文聚焦于人脸检测这一子问题,因其在安全与隐私领域的应用价值突出,但方法不针对人脸特定设计。现有方法依赖视频序列以插值缺失检测,或使用生成模型采样可能的补全结果。本文提出一种单图下的高效无采样方法,利用图像上下文线索推断未见人脸的存在。设计基于热力图的极端非可视目标检测器,通过选择性粗到精解码器,实现从有限图像信息高效推断大量外部区域。实验表明,该方法在新任务上表现优异,甚至超越低效的生成式方法。代码、数据与模型已公开于 https://charliesong1999.github.io/exaft_web/。
原文摘要 · Abstract (English)
Extreme amodal detection is the task of inferring the 2D location of objects that are not fully visible in the input image but are visible within an expanded field-of-view. This differs from amodal detection, where the object is partially visible within the input image, but is occluded. In this paper, we consider the sub-problem of face detection, since this class provides motivating applications involving safety and privacy, but do not tailor our method specifically to this class. Existing approaches rely on image sequences so that missing detections may be interpolated from surrounding frames or make use of generative models to sample possible completions. In contrast, we consider the single-image task and propose a more efficient, sample-free approach that makes use of the contextual cues from the image to infer the presence of unseen faces. We design a heatmap-based extreme amodal object detector that addresses the problem of efficiently predicting a lot (the out-of-frame region) from a little (the image) with a selective coarse-to-fine decoder. Our method establishes strong results for this new task, even outperforming less efficient generative approaches. Code, data, and models are available at https://charliesong1999.github.io/exaft_web/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。