用检索增强方法提升二进制程序聚类,显著优于现有自监督模型。
Self-Supervised Representations for Binary Program Clustering: From Empirical Study to Retrieval-Augmented Learning
- 提出VIME-R,通过检索生成训练样本对,增强表格式表示学习。
- 在Ember和Bodmas数据集上,新方法使同质性提升2.7%至5.8%。
- 首次系统验证自监督学习在无标签二进制程序聚类中的有效性与潜力。
恶意软件聚类是网络安全中发现威胁和分析演化家族的关键任务。尽管自监督学习(SSL)和表格式表示学习(TRL)在其他领域取得突破,其在二进制程序聚类(即对所有输入样本进行聚类,无需标签)中的应用仍基本未被探索。本研究首次系统评估了SSL与TRL方法在该任务上的表现,分两阶段在公开的Ember和Bodmas数据集上展开。第一阶段通过监督配对生成,将主流视觉自监督模型(BYOL、SimSiam、Barlow Twins、VICReg)适配为表格式数据模型,发现BYOL与SimSiam性能接近全监督模型,而Barlow Twins与VICReg表现明显较差。第二阶段评估纯无监督TRL方法,对比强基线(PCA、Autoencoder、UMAP),结果表明VIME建立新基准。基于此,提出VIME-R——一种检索增强的VIME扩展,以检索增强取代随机边缘分布扰动,生成更具信息量的训练对。VIME-R进一步提升性能,在两个数据集上同质性提高2.7%~5.8%。结果表明,检索增强的表格式表示学习是提升自动化恶意软件分析的重要方向。代码将公开。
原文摘要 · Abstract (English)
Malware clustering is a critical task in cybersecurity that helps discover threats and analyze evolving malware families. While self-supervised learning (SSL) and tabular representation learning (TRL) have achieved breakthroughs in other domains, their application to binary program clustering (the task of clustering all incoming samples regardless of label) remains largely unexplored. This study presents the first systematic investigation of SSL and TRL methods for binary program clustering, conducted in two phases on the public Ember and Bodmas datasets. In Phase 1, we establish a performance ceiling by adapting prominent vision-based SSL models (BYOL, SimSiam, Barlow Twins, VICReg) for tabular data with supervised pair generation, finding that BYOL and SimSiam achieve performance comparable to fully supervised models, while Barlow Twins and VICReg significantly underperform. In Phase 2, we evaluate purely unsupervised TRL methods against strong baselines (PCA, Autoencoder, UMAP), demonstrating that VIME establishes a new state of the art for binary program clustering. Informed by these findings, we propose VIME-R, a retrieval-augmented extension of VIME that replaces random marginal-distribution corruption with retrieval-based augmentation to generate more informative training pairs. VIME-R further improves upon VIME, achieving 2.7\%-5.8\% higher Homogeneity on both datasets. Our results highlight retrieval-augmented tabular representation learning as a promising direction for enhancing automated malware analysis. Code will be made available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。