arXiv:2512.18269cs.CV2025-12

构建首个公开暗模式视觉数据集,实现92.8%准确率实时检测。

Building UI/UX Dataset for Dark Pattern Detection and YOLOv12x-based Real-Time Object Recognition Detection System

  • 自建4066张截图数据集,标注5类暗模式组件。
  • 基于YOLOv12x模型实现92.8% mAP@50与40.5FPS实时检测。
  • 数据集开源,助力暗模式识别技术发展。

随着数字化转型加速和在线平台广泛应用,暗模式(用户界面设计削弱用户理性决策能力)引发的社会与技术问题日益突出。为应对企业设计策略日益复杂带来的挑战,本文提出一种兼具高精度与实时性的视觉暗模式检测框架。研究通过人工采集来自韩国及海外六大行业共194个网站的4,066张UI/UX截图,构建了首个公开的视觉暗模式检测数据集。所有图像均标注了五类典型暗模式组件:按钮、复选框、输入框、弹窗和二维码。为实现实时检测,采用YOLOv12x模型并应用迁移学习优化其性能。实验表明,该方法在mAP@50上达到92.8%的高准确率,推理速度保持在40.5帧/秒,验证了其在实际网络环境中的部署可行性。此外,本研究构建的数据集已公开于GitHub:https://github.com/B4E2/B4E2-DarkPattern-YOLO-DataSet,以推动相关领域研究进展。

原文摘要 · Abstract (English)

With the accelerating pace of digital transformation and the widespread adoption of online platforms, both social and technical concerns regarding dark patterns-user interface designs that undermine users' ability to make informed and rational choices-have become increasingly prominent. As corporate online platforms grow more sophisticated in their design strategies, there is a pressing need for proactive and real-time detection technologies that go beyond the predominantly reactive approaches employed by regulatory authorities. In this paper, we propose a visual dark pattern detection framework that improves both detection accuracy and real-time performance. To this end, we constructed a proprietary visual object detection dataset by manually collecting 4,066 UI/UX screenshots containing dark patterns from 194 websites across six major industrial sectors in South Korea and abroad. The collected images were annotated with five representative UI components commonly associated with dark patterns: Button, Checkbox, Input Field, Pop-up, and QR Code. This dataset has been publicly released to support further research and development in the field. To enable real-time detection, this study adopted the YOLOv12x object detection model and applied transfer learning to optimize its performance for visual dark pattern recognition. Experimental results demonstrate that the proposed approach achieves a high detection accuracy of 92.8% in terms of mAP@50, while maintaining a real-time inference speed of 40.5 frames per second (FPS), confirming its effectiveness for practical deployment in online environments. Furthermore, to facilitate future research and contribute to technological advancements, the dataset constructed in this study has been made publicly available at https://github.com/B4E2/B4E2-DarkPattern-YOLO-DataSet.

暗模式检测视觉识别YOLO数据集

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。