用机器学习和特征工程缩小内存取证中的语义鸿沟。
Bridging the Semantic Gap in Virtual Machine Introspection and Forensic Memory Analysis
- 通过元数据与工程化特征提升原始内存数据的可解释性。
- 在数据稀缺时仍达80%以上F1分数,数据越多泛化能力越强。
- 适合安全分析、数字取证人员,尤其关注自动化内存分析者。
数字取证与虚拟机内省(VMI)是虚拟化环境下保障安全的关键技术,需从系统内存中提取信息以识别和解析安全事件。两者面临的核心挑战是‘语义鸿沟’——缺乏专业工具与知识难以解读原始内存数据。本文研究如何利用先验知识、元数据及工程化特征,结合机器学习实现信息自动提取,减轻取证人员负担。以OpenSSH为案例,测试了从统计特征到基于malloc头与指针映射的图表示等多类特征的有效性。训练与测试基于公开数据集,对比现有基线方法。结果表明,引入元数据可在数据极少时显著提升算法性能,并量化显示更多数据带来更好泛化能力。最终贡献是一个超过1TB的物理内存转储开放数据集,涵盖多种内存状态、软件环境、主存容量与操作系统版本。所有方法均在使用元数据时获得超80%的F1分数,验证了特征工程与机器学习在弥合语义鸿沟中的潜力。
原文摘要 · Abstract (English)
Forensic Memory Analysis (FMA) and Virtual Machine Introspection (VMI) are critical tools for security in a virtualization-based approach. VMI and FMA involves using digital forensic methods to extract information from the system to identify and explain security incidents. A key challenge in both FMA and VMI is the "Semantic Gap", which is the difficulty of interpreting raw memory data without specialized tools and expertise. In this work, we investigate how a priori knowledge, metadata and engineered features can aid VMI and FMA, leveraging machine learning to automate information extraction and reduce the workload of forensic investigators. We choose OpenSSH as our use case to test different methods to extract high level structures. We also test our method on complete physical memory dumps to showcase the effectiveness of the engineered features. Our features range from basic statistical features to advanced graph-based representations using malloc headers and pointer translations. The training and testing are carried out on public datasets that we compare against already recognized baseline methods. We show that using metadata, we can improve the performance of the algorithm when there is very little training data and also quantify how having more data results in better generalization performance. The final contribution is an open dataset of physical memory dumps, totalling more than 1 TB of different memory state, software environments, main memory capacities and operating system versions. Our methods show that having more metadata boosts performance with all methods obtaining an F1-Score of over 80%. Our research underscores the possibility of using feature engineering and machine learning techniques to bridge the semantic gap.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。