arXiv:2508.03209cs.CVcs.AI2025-08AAAI被引 4

用对抗扰动保护图片地理隐私,防大模型猜位置。

GeoShield: Safeguarding Geolocation Privacy from Vision-Language Models via Adversarial Perturbations

  • 分离图像中的地理与非地理信息,精准定位暴露位置
  • 多尺度优化扰动,高分辨率下仍有效且影响小
  • 首个针对视觉语言模型的地理隐私防御方案

视觉语言模型(如 GPT-4o)如今能从公开分享的图片中精准推断用户位置,严重威胁地理隐私。尽管对抗扰动可提供防御,但现有方法在高分辨率图像和低扰动预算下表现不佳,且可能引入无关语义内容。为此,我们提出 GeoShield,一种专为真实场景设计的鲁棒地理隐私保护框架。该框架包含三个模块:特征解耦模块分离地理与非地理信息,曝光区域识别模块定位图像中泄露位置的区域,以及尺度自适应增强模块,在全局与局部层面联合优化扰动,确保跨分辨率有效性。大量实验表明,GeoShield 在黑盒设置下持续优于现有方法,以极小视觉或语义损失实现强隐私保护。据我们所知,这是首个探索对抗扰动以防御先进视觉语言模型地理推断的研究,为日益严峻的隐私问题提供了实用有效的解决方案。

原文摘要 · Abstract (English)

Vision-Language Models (VLMs) such as GPT-4o now demonstrate a remarkable ability to infer users' locations from public shared images, posing a substantial risk to geoprivacy. Although adversarial perturbations offer a potential defense, current methods are ill-suited for this scenario: they often perform poorly on high-resolution images and low perturbation budgets, and may introduce irrelevant semantic content. To address these limitations, we propose GeoShield, a novel adversarial framework designed for robust geoprivacy protection in real-world scenarios. GeoShield comprises three key modules: a feature disentanglement module that separates geographical and non-geographical information, an exposure element identification module that pinpoints geo-revealing regions within an image, and a scale-adaptive enhancement module that jointly optimizes perturbations at both global and local levels to ensure effectiveness across resolutions. Extensive experiments on challenging benchmarks show that GeoShield consistently surpasses prior methods in black-box settings, achieving strong privacy protection with minimal impact on visual or semantic quality. To our knowledge, this work is the first to explore adversarial perturbations for defending against geolocation inference by advanced VLMs, providing a practical and effective solution to escalating privacy concerns.

地理隐私对抗样本视觉语言模型数据安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。