为Transformer模型引入不确定性量化,提升暗模式检测的可信度。
Uncertainty Quantification for Transformer Models for Dark-Pattern Detection
- 在分类头采用差异微调,结合SNGP与BNN实现不确定性量化。
- 保持模型性能的同时,揭示预测置信度与困难样本特征。
- 适用于需高可解释性与信任度的UI安全场景,如暗模式识别。
Transformer模型在用户界面中的暗模式检测等易受不道德行为影响的应用中,其黑箱特性导致信任缺失。本文提出一种在最终分类头实施的差异化微调方法,结合不确定性量化技术,使用预训练Transformer模型进行检测。以密集神经网络(DNN)为基线,对比分析谱归一化神经高斯过程(SNGPs)与贝叶斯神经网络(BNNs)两种不确定性量化方法。评估涵盖多个维度:模型性能、预测置信度方差以及训练与推理阶段的环境影响。结果表明,引入不确定性量化可维持性能,同时提供对复杂样本的洞察;且环境影响并非随量化技术引入而单调上升。研究证实,不确定性量化提升了模型透明度,增强了预测可解释性,有助于降低暗模式对用户决策的影响,支持更明智的系统设计与监管决策。
原文摘要 · Abstract (English)
The opaque nature of transformer-based models, particularly in applications susceptible to unethical practices such as dark-patterns in user interfaces, requires models that integrate uncertainty quantification to enhance trust in predictions. This study focuses on dark-pattern detection, deceptive design choices that manipulate user decisions, undermining autonomy and consent. We propose a differential fine-tuning approach implemented at the final classification head via uncertainty quantification with transformer-based pre-trained models. Employing a dense neural network (DNN) head architecture as a baseline, we examine two methods capable of quantifying uncertainty: Spectral-normalized Neural Gaussian Processes (SNGPs) and Bayesian Neural Networks (BNNs). These methods are evaluated on a set of open-source foundational models across multiple dimensions: model performance, variance in certainty of predictions and environmental impact during training and inference phases. Results demonstrate that integrating uncertainty quantification maintains performance while providing insights into challenging instances within the models. Moreover, the study reveals that the environmental impact does not uniformly increase with the incorporation of uncertainty quantification techniques. The study's findings demonstrate that uncertainty quantification enhances transparency and provides measurable confidence in predictions, improving the explainability and clarity of black-box models. This facilitates informed decision-making and mitigates the influence of dark-patterns on user interfaces. These results highlight the importance of incorporating uncertainty quantification techniques in developing machine learning models, particularly in domains where interpretability and trustworthiness are critical.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。