首人称视频可能泄露佩戴者隐私,研究揭示其高风险性。
EgoPrivacy: What Your First-Person Camera Says About You?
- 构建首个首人称视觉隐私基准EgoPrivacy,覆盖三类隐私信息
- 零样本下模型可80%准确识别身份、性别等属性
- 提出检索增强攻击,利用外部视频提升隐私泄露效果
可穿戴摄像头的普及引发了对首人称视频隐私的担忧,但以往研究多忽略对佩戴者自身的隐私威胁。本文提出核心问题:从首人称视频中能推断多少关于佩戴者的信息?我们构建了EgoPrivacy,首个大规模基准,用于全面评估首人称视觉中的隐私风险。该基准涵盖三类隐私(人口统计、个体、情境),定义七项任务,目标是恢复从精细(如身份)到粗粒度(如年龄组)的私密信息。为强调首人称视觉固有的隐私风险,我们提出检索增强攻击(Retrieval-Augmented Attack),利用外部视角视频池进行自我到外部视频检索,显著提升人口统计类隐私攻击效果。在多种威胁模型下的广泛对比显示,佩戴者隐私极易泄露。例如,基础模型在零样本设置下即可实现70-80%准确率,恢复身份、场景、性别和种族等属性。代码与数据已公开于https://github.com/williamium3000/ego-privacy。
原文摘要 · Abstract (English)
While the rapid proliferation of wearable cameras has raised significant concerns about egocentric video privacy, prior work has largely overlooked the unique privacy threats posed to the camera wearer. This work investigates the core question: How much privacy information about the camera wearer can be inferred from their first-person view videos? We introduce EgoPrivacy, the first large-scale benchmark for the comprehensive evaluation of privacy risks in egocentric vision. EgoPrivacy covers three types of privacy (demographic, individual, and situational), defining seven tasks that aim to recover private information ranging from fine-grained (e.g., wearer's identity) to coarse-grained (e.g., age group). To further emphasize the privacy threats inherent to egocentric vision, we propose Retrieval-Augmented Attack, a novel attack strategy that leverages ego-to-exo retrieval from an external pool of exocentric videos to boost the effectiveness of demographic privacy attacks. An extensive comparison of the different attacks possible under all threat models is presented, showing that private information of the wearer is highly susceptible to leakage. For instance, our findings indicate that foundation models can effectively compromise wearer privacy even in zero-shot settings by recovering attributes such as identity, scene, gender, and race with 70-80% accuracy. Our code and data are available at https://github.com/williamium3000/ego-privacy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。