艺术化人行横道可能干扰视觉感知系统,导致漏检或误检。
Understanding the Risks of Asphalt Art to the Reliability of Vision-Based Perception Systems
- 用真实场景合成艺术化斑马线,测试检测模型性能。
- 复杂高亮图案使行人检测准确率下降超过30%。
- 黑客可伪造艺术图案制造虚假行人或隐藏真实行人。
近年来,各地组织引入了以沥青艺术装饰的人行横道,旨在提升行人可见性与安全性。然而,其视觉复杂性可能干扰依赖视觉的物体检测模型。本研究考察了沥青艺术对预训练视觉检测模型在行人识别上的影响。通过将多种街头艺术图案合成至固定监控场景,评估模型在正常和对抗性条件下于沥青艺术人行横道上的表现。正常情况指已有的常规沥青艺术,对抗情况则为攻击者数字设计或篡改的艺术图案。结果表明,简单色彩设计影响较小,但高视觉显著性的复杂艺术图案会显著降低行人检测性能。进一步证明,恶意构造的沥青艺术可被用来刻意遮蔽真实行人或生成不存在的行人检测结果。这些发现揭示了城市视觉监控系统潜在风险,强调在设计鲁棒行人感知模型时需考虑环境视觉变化。
原文摘要 · Abstract (English)
Artistic crosswalks featuring asphalt art, introduced by different organizations in recent years, aim to enhance the visibility and safety of pedestrians. However, their visual complexity may interfere with surveillance systems that rely on vision-based object detection models. In this study, we investigate the impact of asphalt art on pedestrian detection performance of a pretrained vision-based object detection model. We construct realistic crosswalk scenarios by compositing various street art patterns into a fixed surveillance scene and evaluate the model's performance in detecting pedestrians on asphalt-arted crosswalks under both benign and adversarial conditions. A benign case refers to pedestrian crosswalks painted with existing normal asphalt art, whereas an adversarial case involves digitally crafted or altered asphalt art perpetrated by an attacker. Our results show that while simple, color-based designs have minimal effect, complex artistic patterns, particularly those with high visual salience, can significantly degrade pedestrian detection performance. Furthermore, we demonstrate that adversarially crafted asphalt art can be exploited to deliberately obscure real pedestrians or generate non-existent pedestrian detections. These findings highlight a potential vulnerability in urban vision-based pedestrian surveillance systems, and underscore the importance of accounting for environmental visual variations when designing robust pedestrian perception models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。