无需配对数据,单视角图像也能实现空地跨视图重识别。
3D-LENS: A 3D Lifting-based Elevated Novel-view Synthesis method for Single-View Aerial-Ground Re-Identification

- 基于3D重建生成视角一致的新视图,避免2D方法的几何失真。
- 在未见视角下达到当前最优性能,适用于野外搜救等真实场景。
- 无需预设模板,能保留携带物等细粒度特征,适合多类别应用。
空地重识别(AG-ReID)受限于视角差异导致的特征遮挡或扭曲,跨视角检索困难。现有方法依赖成对的跨视角标注,但实际应用如野外搜救常缺乏目标域数据,需仅凭地面参考进行检索。我们首次提出单视角空地重识别(SV AG-ReID)设定,即模型在单一真实视角训练后,需泛化至未见视角。提出3D-LENS框架,结合大规模3D网格重建的几何一致新视图合成与鲁棒表示学习,缓解合成到真实间的偏差。相比2D生成方法的几何不一致或依赖类别特定模板的3D方法,本方案无需预设模板即可在多样化类别间保持视角一致性,准确捕捉携带物等细节。大量实验表明,该方法在单视角空地重识别任务中达到领先水平。代码与数据将发布于https://github.com/TurtleSmoke/3D-LENS。
原文摘要 · Abstract (English)
Aerial-Ground Re-Identification (AG-ReID) is constrained by the viewpoint-domain gap, as drastic viewpoint disparities occlude or distort discriminative features, making cross-viewpoint image retrieval challenging. While existing methods rely on paired cross-view annotations, real-world deployments, such as wilderness search-and-rescue (SAR), often lack target-domain data, requiring retrieval from ground-level references alone. To our knowledge, we are the first to address this challenge by formalizing the Single-View AG-ReID (SV AG-ReID) setting, where models trained on a single real viewpoint must generalize to an unseen viewpoint. We propose 3D Lifting-based Elevated Novel-view Synthesis (3D-LENS), a unified framework combining geometrically-consistent novel view synthesis that leverages large-scale 3D mesh reconstruction, with a robust representation learning scheme to mitigate synthetic-to-real bias. Unlike 2D generative baselines that suffer from geometric inconsistencies or prior 3D methods that are restricted to class-specific templates, our approach ensures view-consistent synthesis across diverse categories without predefined templates that fail to capture fine-grained details, such as carried objects. Extensive experiments demonstrate that our method achieves state-of-the-art performance on SV AG-ReID scenarios. Code and data will be released at https://github.com/TurtleSmoke/3D-LENS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。