提出可视化车牌恢复边界的映射方法,评估极端视角下识别可行性。
Mapping License Plate Recoverability Under Extreme Viewing Angles for Opportunistic Urban Sensing
- 通过合成数据扫描多种退化参数,构建恢复能力地图
- 最佳模型恢复约93%的参数空间,且不同架构表现相近
- 适合城市感知中利用非专用摄像头做车牌识别的研究者
城市环境中存在大量为特定目的设计的成像传感器,如ATM、随身佩戴、CCTV和车载摄像头。在机会式感知范式下,这些传感器可被用于车牌识别等二次任务。然而,图像中的目标常受噪声、低分辨率和极端视角影响。近期基于AI的图像修复技术可在严重退化图像中恢复有用信息。核心挑战在于确定哪些退化参数仍可实现可靠恢复,哪些会导致识别失败。本文提出恢复性映射(recoverability maps),一种与任务无关的方法,用于量化该边界。该方法结合密集的合成退化参数扫描,以及两个总结度量:边界曲线下面积(boundary area-under-curve),估计可恢复的参数空间比例;可靠性评分,衡量该区域内失败的频率与严重程度。我们在真实相机伪影条件下,对高度倾斜视角下的车牌识别任务进行了验证。训练并评估了多种修复架构,包括U-Net、Restormer、Pix2Pix和SR3扩散模型。最佳模型恢复约93%的参数空间。各模型结果相似,表明感知几何结构而非网络架构是恢复上限的关键因素。
原文摘要 · Abstract (English)
Urban environments contain many imaging sensors built for specific purposes, including ATM, body-worn, CCTV, and dashboard cameras. Under the opportunistic sensing paradigm, these sensors can be repurposed for secondary inference tasks such as license plate recognition. Yet objects of interest in such im-agery are often noisy, low-resolution, and captured from extreme viewpoints. Recent advances in AI-based restoration can recover useful information even from severely degraded images. A central challenge is de-termining which distortion parameters allow reliable recovery and which lead to inference failure. This paper introduces recoverability maps, a task-agnostic method for quantifying this boundary. The method combines a dense synthetic sweep of degradation parameters with two summary measures: boundary ar-ea-under-curve, which estimates the recoverable fraction of the parameter space, and a reliability score, which captures the frequency and severity of failures within that region. We demonstrate the method on li-cense plate recognition from highly angled views under realistic camera artifacts. Several restoration archi-tectures are trained and evaluated, including U-Net, Restormer, Pix2Pix, and SR3 diffusion. The best model recovers about 93% of the parameter space. Similar results across models suggest that sensing geometry, ra-ther than architecture, sets the limit of recovery.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。