提出新基准评估图模型在未知安卓恶意软件上的泛化能力
Quantifying the Generalization Gap: A New Benchmark for Out-of-Distribution Graph-Based Android Malware Classification
- 构建两个模拟分布偏移的基准数据集,模拟真实场景
- 发现仅用调用图结构时性能下降最高达45%
- 用语义增强提升特征表达,显著改善模型鲁棒性
尽管基于图的安卓恶意软件分类器在标准基准上准确率超过94%,但在分布偏移下存在显著泛化差距,面对已知家族的未见变种时性能最高下降45%。本文系统研究这一被忽视的问题,提出两个模拟典型场景的基准:MalNet-Tiny-Common(协变量偏移)和MalNet-Tiny-Distinct(领域偏移)。进一步发现,现有基准仅使用结构化的函数调用图,无法捕捉促进鲁棒泛化的潜在语义模式。为此,构建语义增强框架,在原始拓扑基础上加入函数级属性,包括轻量级元数据和LLM生成的代码嵌入。实验证明,该数据驱动方法在分布偏移下表现优于纯模型方法,并能持续提升鲁棒性。论文公开预计算数据集及可扩展的完整处理流程,为构建适应演进威胁环境的弹性检测系统奠定基础。
原文摘要 · Abstract (English)
While graph-based Android malware classifiers achieve over 94% accuracy on standard benchmarks, they exhibit a significant generalization gap under distribution shift, suffering up to 45% performance degradation when encountering unseen malware variants from known families. This work systematically investigates this critical yet overlooked challenge for real-world deployment by introducing a benchmarking suite designed to simulate two prevalent scenarios: MalNet-Tiny-Common for covariate shift, and MalNet-Tiny-Distinct for domain shift. Furthermore, we identify an inherent limitation in existing benchmarks where the inputs are structure-only function call graphs, which fails to capture the latent semantic patterns necessary for robust generalization. To verify this, we construct a semantic enrichment framework that augments the original topology with function-level attributes, including lightweight metadata and LLM-based code embeddings. By providing this expanded feature set, we aim to equip future research with richer behavioral information to facilitate the development of more sophisticated detection techniques. Empirical evaluations confirm the effectiveness of our data-centric methodology, with which classification performs better under distribution shift compared to model-based approaches, and consistently further enhances robustness when used in conjunction. We release our precomputed datasets, along with an extensible implementation of our comprehensive pipeline, to lay the groundwork for building resilient malware detection systems for evolving threat environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。