用三元组损失端到端训练,提升移动设备中个人数据泄露检测效果。
End-to-End triplet loss based fine-tuning for network embedding in effective PII detection
- 结合大语言模型与自编码器生成网络包嵌入表示
- 三元组损失微调使检测准确率在两个真实数据集上显著提升
- 无需人工特征工程,适合安全监控与隐私保护场景
在移动数据生态中,许多方法通过分析用户设备上应用产生的网络流量来检测个人数据外泄。当前先进方法依赖从HTTP请求中提取的特征,通常需人工标注数据并训练分类器。然而,多数方法在模型训练前需进行外部特征选择。深度学习则可自主学习数据模式,无需此类预处理。本文提出一种基于深度学习的端到端框架,用于预测移动包中的个人身份信息(PII)暴露情况。该框架采用预训练大语言模型(LLM)和自编码器生成网络包嵌入,并使用三元组损失进行微调,在两个真实世界数据集上提升了检测有效性。我们将其与现有最优方法对比,验证了其在识别用户设备中PII泄露方面的优越性能。
原文摘要 · Abstract (English)
There are many approaches in mobile data ecosystem that inspect network traffic generated by applications running on user's device to detect personal data exfiltration from the user's device. State-of-the-art methods rely on features extracted from HTTP requests and in this context, machine learning involves training classifiers on these features and making predictions using labelled packet traces. However, most of these methods include external feature selection before model training. Deep learning, on the other hand, typically does not require such techniques, as it can autonomously learn and identify patterns in the data without external feature extraction or selection algorithms. In this article, we propose a novel deep learning based end-to-end learning framework for prediction of exposure of personally identifiable information (PII) in mobile packets. The framework employs a pre-trained large language model (LLM) and an autoencoder to generate embedding of network packets and then uses a triplet-loss based fine-tuning method to train the model, increasing detection effectiveness using two real-world datasets. We compare our proposed detection framework with other state-of-the-art works in detecting PII leaks from user's device.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。