arXiv:2607.20216cs.CRcs.AI2026-07

用小模型组合比单个大模型更准地分析恶意软件报告

Small, Free, and Effective: Orchestrating Open-Weight Small Language Models to Outperform Single LLM for Malware Analysis

  • 用多个小模型分阶段协作,先收集证据再推理
  • 混合架构使准确率提升至35.30%,超过单一大模型的34.77%
  • 适合资源有限但需高效恶意软件分析的团队

恶意软件分析需要快速理解包含文件系统、网络和进程行为的复杂爆炸报告。尽管大型语言模型(LLMs)在技术文档解析方面表现优异,但闭源前沿模型的不透明性和不断攀升的API成本,促使人们探索开源权重的替代方案。然而,许多开源模型体积庞大,需大量计算资源,且部署成本高昂,难以在资源受限环境中应用。本文研究了小型语言模型(SLMs)协同集成是否能在结构化问题上超越单个大模型的性能。我们在Meta的CyberSecEval恶意软件分析基准上测试了11个开源小模型、3个网络安全预训练模型和6个前沿大模型作为基线。随后设计并评估了四种协调架构:(i) 多智能体流水线,将分析分解为结构化证据收集与推理阶段;(ii) 对抗性辩论框架,两个智能体迭代批判彼此推理;(iii) 分层咨询系统,结合通用型小模型与网络安全专家模型;(iv) 混合架构,融合证据驱动流水线与对抗辩论推理。混合系统(Qwen3-4B + Foundation-Sec-8B)达到35.30%的整体准确率,优于最强的网络安全专用基线(22.54%)和最强的无证据基线(34.77%);在相同证据管道下,基于接地的Gemini配置仍是最优,达38.22%。结果表明,证据驱动的协调机制能显著提升协作小模型在恶意软件报告解读中的表现。

原文摘要 · Abstract (English)

Malware analysis demands rapid interpretation of complex detonation reports spanning filesystem, network, and process behaviours. While large language models (LLMs) demonstrate impressive capabilities for technical artifact interpretation, the opacity and escalating API costs of closed-weight frontier models motivate exploration of open-weight alternatives. However, many open-weight models are large, demanding significant compute resources and incurring non-trivial hosting costs that place them beyond reach for resource-constrained deployments. This paper investigates whether orchestrated ensembles of small language models (SLMs) can match or exceed single LLM performance on structured questions about malware detonation reports. We established baselines by testing eleven open-weight SLMs, three cyber security pre-trained models, and six frontier LLMs on Meta's CyberSecEval Malware Analysis benchmark. We then designed and evaluated four orchestration architectures: (i) a multi-agent pipeline that decomposes analysis into structured evidence-collection and reasoning stages, (ii) an adversarial debate framework in which two agents iteratively critique each other's reasoning, (iii) a hierarchical consultation system that pairs a general-purpose SLM with a cyber-specialised expert model, and (iv) a hybrid architecture that combines evidence-grounded pipelines with adversarial debate reasoning. The hybrid system (Qwen3-4B with Foundation-Sec-8B) achieved 35.30% overall accuracy, exceeding the strongest cyber-specialised baseline (22.54%) and the strongest ungrounded frontier baseline (34.77%); when given the same evidence pipeline, grounded Gemini remained the strongest configuration at 38.22%. These findings show that evidence-grounded orchestration can substantially improve the performance of collaborative SLMs for supporting interpretation of malware detonation reports.

恶意软件分析小模型协同推理安全检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。