用网络日志识别模拟用户是否像真人,提升安全环境真实性
PHASE: Passive Human Activity Simulation Evaluation
- 通过分析Zeek日志被动区分人类与非人类行为
- 识别出合成用户存在明显非人特征,准确率超90%
- 适合安全仿真、红蓝对抗等需真实用户行为的场景
网络安全仿真环境(如网络靶场、蜜罐、沙箱)需要真实的人类行为才能有效,但目前缺乏量化评估合成用户行为真实性的方法。本文提出PHASE(Passive Human Activity Simulation Evaluation),一种基于机器学习的框架,利用Zeek连接日志以超过90%的准确率区分人类与非人类活动。该方法完全被动运行,仅依赖标准网络监控,无需用户端部署或可见监视。所有用于机器学习的网络流量均通过Zeek网络设备采集,避免引入额外流量或干扰仿真环境的真实性。论文还提出一种新型标注方法,利用本地DNS记录对网络流量进行分类,支持机器学习分析。进一步采用SHAP分析揭示了真实用户的时间与行为特征。在案例研究中,我们评估了一个合成用户人格,识别出显著的非人类模式,影响行为真实性。基于此,我们改进了行为配置,显著提升了合成活动的人类相似性,使模拟用户更具现实性和有效性。
原文摘要 · Abstract (English)
Cybersecurity simulation environments, such as cyber ranges, honeypots, and sandboxes, require realistic human behavior to be effective, yet no quantitative method exists to assess the behavioral fidelity of synthetic user personas. This paper presents PHASE (Passive Human Activity Simulation Evaluation), a machine learning framework that analyzes Zeek connection logs and distinguishes human from non-human activity with over 90\% accuracy. PHASE operates entirely passively, relying on standard network monitoring without any user-side instrumentation or visible signs of surveillance. All network activity used for machine learning is collected via a Zeek network appliance to avoid introducing unnecessary network traffic or artifacts that could disrupt the fidelity of the simulation environment. The paper also proposes a novel labeling approach that utilizes local DNS records to classify network traffic, thereby enabling machine learning analysis. Furthermore, we apply SHAP (SHapley Additive exPlanations) analysis to uncover temporal and behavioral signatures indicative of genuine human users. In a case study, we evaluate a synthetic user persona and identify distinct non-human patterns that undermine behavioral realism. Based on these insights, we develop a revised behavioral configuration that significantly improves the human-likeness of synthetic activity yielding a more realistic and effective synthetic user persona.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。