arXiv:2504.21846cs.CVcs.AI2025-04被引 1

用微弱光信号给演讲视频加物理指纹,防伪造且难破解。

Combating Falsification of Speech Videos with Live Optical Signatures (Extended Version)

  • 在拍摄现场投射不可见光,生成唯一语音事件特征指纹。
  • 检测准确率100%,AUC超0.99,抗剪辑与对抗攻击。
  • 适合媒体、政要直播等高风险场景的视频真实性验证。

高影响力演讲视频易被伪造,因其传播广且影响大。本文提出VeriLight系统,通过在事件现场生成动态物理签名,并以人眼不可察觉的调制光嵌入所有视频记录中,实现对说话人身份和唇部及面部动作的视觉篡改防护。该签名编码了语义相关的事件特征(如说话人身份与面部运动),并经密码学保护防止伪造。任何下游视频均可提取签名并与内容比对以验证完整性。核心包括:(1) 基于局部敏感哈希的极紧凑(150比特)、姿态不变的语音视频特征生成框架;(2) 能嵌入超过200 bps信息且在视频与现场均不可见的光学调制方案。在多个大规模数据集上的实验表明,VeriLight在检测伪造视频时达到AUC ≥ 0.99,真阳性率100%。此外,其对不同拍摄条件、视频后处理及白盒对抗攻击具有高度鲁棒性。演示可访问 https://mobilex.cs.columbia.edu/verilight。

原文摘要 · Abstract (English)

High-profile speech videos are prime targets for falsification, owing to their accessibility and influence. This work proposes VeriLight, a low-overhead and unobtrusive system for protecting speech videos from visual manipulations of speaker identity and lip and facial motion. Unlike the predominant purely digital falsification detection methods, VeriLight creates dynamic physical signatures at the event site and embeds them into all video recordings via imperceptible modulated light. These physical signatures encode semantically-meaningful features unique to the speech event, including the speaker's identity and facial motion, and are cryptographically-secured to prevent spoofing. The signatures can be extracted from any video downstream and validated against the portrayed speech content to check its integrity. Key elements of VeriLight include (1) a framework for generating extremely compact (i.e., 150-bit), pose-invariant speech video features, based on locality-sensitive hashing; and (2) an optical modulation scheme that embeds $>$200 bps into video while remaining imperceptible both in video and live. Experiments on extensive video datasets show VeriLight achieves AUCs $\geq$ 0.99 and a true positive rate of 100% in detecting falsified videos. Further, VeriLight is highly robust across recording conditions, video post-processing techniques, and white-box adversarial attacks on its feature extraction methods. A demonstration of VeriLight is available at https://mobilex.cs.columbia.edu/verilight.

视频防伪物理签名光信号嵌入数字取证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。