arXiv:2606.31875cs.CV2026-06

首个面向自动驾驶社会性异常的视频检测基准,聚焦关系异常而非运动信号。

SENSE-VAD: Sentient and Semantic Video Anomaly Detection for Autonomous Driving

  • 基于CARLA与UE生成多类社会关系异常场景,分离社会异常与运动/外观异常。
  • 构建包含个体、群体、人-物交互等六类异常的带帧级标签数据集。
  • 揭示现有方法在社会关系异常检测上严重不足,适合自动驾驶安全研究者。

自动驾驶车辆不仅需应对运动型危险,还需识别由多方关系构成的社会复杂情境——如儿童脱离监护人、有人被背负、追逐者沿人行道追击行人等,这些行为虽无明显运动异常,却具有显著社会异常性。现有异常检测模型难以捕捉此类情境。本文提出SENSE-VAD,首个专为自动驾驶设计的社会性视频异常检测基准。利用CARLA模拟器与Unreal Engine(UE)生成多类别异常场景:个体行为、群体行为、人-物交互、骑手互动、车辆与行人间交互等,并提供逐帧二值标注。核心设计原则是将社会异常与运动或外观异常相分离:许多场景中物体运动本身正常,但在关系上下文中异常。同时提供真实世界正常与异常视频,用于评估模拟到现实的迁移性能。我们评测了当前主流视频异常检测基线,证明社会复杂异常构成独立且尚未解决的挑战。数据集、标注与生成代码已公开。

原文摘要 · Abstract (English)

Autonomous vehicles (AVs) must navigate not only motion-based hazards but also socially complex situations whose danger is constituted by inter-agent relationships rather than movement statistics alone. A child running away from a guardian, a person being carried by another, or a pursuer chasing a pedestrian across a sidewalk are all anomalous in social context, yet none produces an obvious motion signal that current anomaly detectors are equipped to flag. We introduce SENSE-VAD, the first synthetic video anomaly detection benchmark for autonomous driving explicitly designed around socially complex anomalies. Using the CARLA simulator and Unreal Engine (UE), we generate distinct anomaly scenarios across multiple categories: individual behaviors, group behaviors, person--object interactions, cyclist interactions, vehicle & agent, each annotated with per-frame binary labels. A key design principle is the separation of social anomaly from motion-based or appearance-based anomaly: many scenarios involve motion of objects that appears unremarkable in isolation but is anomalous in relational context. We additionally provide real-world normal and anomalous videos as a sim-to-real transfer probe. We evaluate state-of-the-art video anomaly detection baselines and demonstrate that socially complex anomalies constitute a distinct and currently unsolved challenge. Our dataset, annotations, and generation code are publicly available.

视频异常检测自动驾驶社会关系合成数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。