通过分析API调用序列,用动态行为识别隐藏的木马程序。
SeqShield: A Behavioral Analysis Approach to Uncover Rootkits

- 用API调用序列建模,捕捉木马恶意行为特征。
- 最高准确率达97.81%,优于传统静态检测方法。
- 适合安全研究人员与系统防护开发人员使用。
根木马是极具隐蔽性的恶意软件,因其变异行为可绕过传统静态分析。基于签名的检测手段难以应对,亟需转向动态分析。本文提出SeqShield,一种专为Windows系统设计的行为式根木马检测方法,通过分析API调用序列来识别恶意行为。我们使用变种代码引擎生成了10倍数量的根木马变异样本,以验证其混淆策略。采用n-gram分析提取二元组和三元组特征,随机森林模型在二元组上达到97.27%准确率,三元组达96.17%。通过吉尼不纯度指数进行特征重要性排序,迭代筛选关键特征,降低维度后,优化后的特征集使大模型在二元组上实现96.72%准确率,三元组达97.81%。
原文摘要 · Abstract (English)
Rootkits are among the most elusive types of malware, capable of bypassing traditional static analysis methods due to their metamorphic behavior. Signature-based detection techniques struggle against these threats, necessitating a shift toward dynamic analysis approaches. We propose SeqShield, a behavior-based rootkit detection approach designed specifically for the Windows OS, leveraging API call sequences for dynamic behavior analysis. Instead of relying on static signatures, SeqShield examines the execution patterns of API calls, which inherently reflect malicious intent. Analyzing API sequences, we can effectively identify rootkit-like behavior. We also employed a metamorphic code engine to generate 10X mutated variants of rootkits, demonstrating their obfuscation strategies. SeqShield applies n-gram analysis to extract bigram and trigram features from these API call sequences, enabling effective detection of rootkit-like activity. Among the models tested, Random Forest achieves the highest accuracy of 97.27% (bigram) and 96.17% (trigram). To optimize performance and decrease the dimension, we apply feature importance ranking using the Gini Impurity Index, iteratively selecting the most significant features. The optimized lower-dimensional feature matrix significantly enhances detection efficiency without sacrificing accuracy. Using the optimized feature set, our approach achieves 96.72% accuracy for bigrams and 97.81% accuracy for trigrams.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。