自动检测手机应用中的欺骗性设计,提升识别效率与覆盖率。
From Exploration to Revelation: Detecting Dark Patterns in Mobile Apps
- 结合大模型引导探索与随机探索,覆盖多种界面状态。
- 检测跨页面和页面内欺骗模式,准确率超90%。
- 适合安全研究者、隐私保护开发者使用。
移动应用广泛使用视觉强化或语言诱导等欺骗性设计操纵用户行为。现有研究多依赖人工检测,效率低且难以应对快速迭代的应用。尽管已有自动化方法,但仅限于单页面检测,需手动探索,灵活性差。为此,我们提出AppRay系统,融合任务导向探索与自动化欺骗模式检测,降低人工成本,扩大检测范围并提升性能。该系统分两阶段运行:首先结合大语言模型引导的任务探索与随机探索,获取多样化的用户界面(UI)状态;其次利用基于对比学习的多标签分类器,结合规则增强的上下文感知模块,检测跨页面与页面内欺骗模式。我们构建了两个数据集:AppRay-Tainted-UIs与AppRay-Benign-UIs,共包含2,185个欺骗模式实例,涵盖149个单页面案例,涉及16类模式,覆盖876个恶意与871个良性界面,保持界面间关系。实验表明,AppRay在宏观/微观精度上达0.92/0.85,召回率为0.86/0.88,F1值为0.89/0.85,较先前方法提升27.14%至1200%,可有效发现此前未被识别的欺骗模式。
原文摘要 · Abstract (English)
Mobile apps are essential in daily life but frequently employ deceptive patterns, such as visual emphasis or linguistic nudging, to manipulate user behavior. Existing research largely relies on manual detection, which is time-consuming and cannot keep pace with rapidly evolving apps. Although recent work has explored automated approaches, these methods are limited to intra-page patterns, depend on manual app exploration, and lack flexibility. To address these limitations, we present AppRay, a system that integrates task-oriented app exploration with automated deceptive pattern detection to reduce manual effort, expand detection coverage, and improve performance. AppRay operates in two stages. First, it combines large language model-guided task-oriented exploration with random exploration to capture diverse user interface (UI) states. Second, it detects both intra-page and inter-page deceptive patterns using a contrastive learning-based multi-label classifier augmented with a rule-based refiner for context-aware detection. We contribute two datasets, AppRay-Tainted-UIs and AppRay-Benign-UIs, comprising 2,185 deceptive pattern instances, including 149 intra-page cases, spanning 16 types across 876 deceptive and 871 benign UIs, while preserving UI relationships. Experimental results show that AppRay achieves macro/micro averaged precision of 0.92/0.85, recall of 0.86/0.88, and F1 scores of 0.89/0.85, yielding 27.14% to 1200% improvements over prior methods and enabling effective detection of previously unexplored deceptive patterns.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。