arXiv:2506.15854cs.CVcs.LG2025-06被引 2

用视觉转文本技术保护自动驾驶车图像隐私,既保留关键信息又防泄露

Privacy-Preserving in Connected and Autonomous Vehicles Through Vision to Text Transformation

  • 通过视觉语言模型将图像转为文本描述,保留场景细节
  • 采用分层强化学习迭代优化文本,提升语义准确性和隐私保护
  • 在两个数据集上隐私指标显著优于现有方法,适合交通监控场景

智能交通系统依赖各类设备处理敏感隐私数据。路边单元配备人工智能摄像头用于检测自动驾驶车辆的交通违规行为,但车内通常被视为私人空间,影像数据仍存在被用于身份盗用、画像或未经授权商业用途的重大风险。现有方法如人脸模糊仍难完全保障隐私。本文提出一种新型隐私保护框架,结合基于反馈的强化学习与视觉-语言模型,创新性地将图像转化为文本描述,在保留主要场景信息的同时实现隐私保护。采用分层强化学习策略迭代优化生成文本,提升语义准确性与隐私性。相比传统基于标题的方法,本模型引入外部知识反馈的迭代强化学习循环,持续优化隐私感知文本。除定性文本评估外,隐私度量指标显示显著改进:在两个不同数据集上,所提方法的SSIM、PSNR、MSE和SRRA值均优于现有方法。

原文摘要 · Abstract (English)

Intelligent Transportation Systems (ITS) rely on a variety of devices that frequently process privacy-sensitive data. Roadside units are important because they use AI-equipped cameras to detect traffic violations in Connected and Autonomous Vehicles (CAV). However, although the interior of a vehicle is generally considered a private space, the privacy risks associated with captured imagery remain a major concern, as such data can be misused for identity theft, profiling, or unauthorized commercial purposes. Methods like face blurring reduce privacy risks, however individuals' privacy can still be compromised. This paper introduces a novel privacy-preserving framework that leverages feedback-based reinforcement learning (RL) and vision-language models (VLMs) to protect sensitive visual information captured by AIE cameras. The proposed idea transforms images into textual descriptions using an innovative method while the main scene details are preserved and protects privacy. A hierarchical RL strategy is employed to iteratively refine the generated text, enhancing both semantic accuracy and privacy. Unlike prior captioning-based methods, our model incorporates an iterative reinforcement-learning cycle with external knowledge feedback which progressively refines privacy-aware text. In addition to qualitative textual metric evaluations, the privacy-based metrics demonstrate significant improvements in privacy preservation where SSIM, PSNR, MSE, and SRRA values obtained using the proposed method on two different datasets outperform other methods.

隐私保护视觉转文本强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。