arXiv:2507.10473cs.CV2025-07ICCV被引 10

将图像时间与位置联合预测,用统一向量空间提升准确性。

GT-Loc: Unifying When and Where in Images Through a Joint Embedding Space

  • 用独立编码器分别处理图像、时间与位置,对齐到共享特征空间。
  • 在环面结构上设计软目标损失,更好建模时间周期性,提升小时/月份预测精度。
  • 适合需要时空联合推理的任务,如数字取证、跨模态检索。

时间戳预测旨在仅通过视觉信息判断图像拍摄时间,支持元数据修复、检索和数字取证等应用。在户外场景中,小时估计依赖亮度、色调和阴影方向,而季节变化与天气则影响日期推断。然而这些视觉线索高度依赖地理环境,使时间预测与地理定位紧密关联。为此,我们提出GT-Loc,一种基于检索的联合方法,同时预测图像的拍摄时间(小时与月份)和地理坐标(GPS)。该方法采用图像、时间与位置的独立编码器,在高维共享特征空间中对齐其嵌入表示。考虑到时间的周期性,我们摒弃传统对比学习中的硬正负样本,提出一种基于环面流形的时序度量学习目标,通过建模成对时间差提供软标签。我们在新基准上验证,该联合优化方法超越了以往所有时间预测模型,甚至优于使用真实地理位置作为输入的方法。此外,本方法在标准地理定位任务上表现优异,统一嵌入空间还支持组合式与文本引导的图像检索。

原文摘要 · Abstract (English)

Timestamp prediction aims to determine when an image was captured using only visual information, supporting applications such as metadata correction, retrieval, and digital forensics. In outdoor scenarios, hourly estimates rely on cues like brightness, hue, and shadow positioning, while seasonal changes and weather inform date estimation. However, these visual cues significantly depend on geographic context, closely linking timestamp prediction to geo-localization. To address this interdependence, we introduce GT-Loc, a novel retrieval-based method that jointly predicts the capture time (hour and month) and geo-location (GPS coordinates) of an image. Our approach employs separate encoders for images, time, and location, aligning their embeddings within a shared high-dimensional feature space. Recognizing the cyclical nature of time, instead of conventional contrastive learning with hard positives and negatives, we propose a temporal metric-learning objective providing soft targets by modeling pairwise time differences over a cyclical toroidal surface. We present new benchmarks demonstrating that our joint optimization surpasses previous time prediction methods, even those using the ground-truth geo-location as an input during inference. Additionally, our approach achieves competitive results on standard geo-localization tasks, and the unified embedding space facilitates compositional and text-based image retrieval.

时空预测联合嵌入图像检索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。