arXiv:2508.18488cs.CRcs.AI2025-08被引 1

安全团队用大模型解析复杂文本,提升响应效率。

Collaborative Intelligence: Topic Modelling of Large Language Model use in Live Cybersecurity Operations

  • 通过对话记录分析人员如何用大模型理解复杂指令
  • 近40%使用场景用于解析复杂文本信息
  • 适合设计嵌入式智能辅助工具的安全部门

本研究描述了在实际网络安全运营中,大型语言模型(LLM)在安全运营中心(SOC)的使用情况。基于某大型网络安全服务商10个月的运营数据,研究人员通过内部部署的HTTP聊天应用记录了操作员对GPT-4的调用。采用BERTopic模型和一种新提出的主题建模流程进行分析。结果表明,操作员主要利用大模型辅助理解复杂文本内容,该类使用占总使用量的约40%。这反映了在快速处理复杂命令与信息时,人员自然倾向借助大模型支持工作。因此,应设计可协同的智能工具以增强其工作流。例如,在安全环境内集成右键菜单,直接触发命令行分析的LLM调用。该研究为下一代安全运营中心工具开发提供了实践依据。

原文摘要 · Abstract (English)

Objective: This work describes the topic modelling of Security Operations Centre (SOC) use of a large language model (LLM), during live security operations. The goal is to better understand how these specialists voluntarily use this tool. Background: Human-automation teams have been extensively studied, but transformer-based language models have sparked a new wave of collaboration. SOC personnel at a major cybersecurity provider used an LLM to support live security operations. This study examines how these specialists incorporated the LLM into their work. Method: Our data set is the result of 10 months of SOC operators accessing GPT-4 over an internally deployed HTTP-based chat application. We performed two topic modelling exercises, first using the established BERTopic model (Grootendorst, 2022), and second, using a novel topic modeling workflow. Results: Both the BERTopic analysis and novel modelling approach revealed that SOC operators primarily used the LLM to facilitate their understanding of complex text strings. Variations on this use-case accounted for ~40% of SOC LLM usage. Conclusion: SOC operators are required to rapidly interpret complex commands and similar information. Their natural tendency to leverage LLMs to support this activity indicates that their workflow can be supported and augmented by designing collaborative LLM tools for use in the SOC. Application: This work can aid in creating next-generation tools for Security Operations Centres. By understanding common use-cases, we can develop workflows supporting SOC task flow. One example is a right-click context menu for executing a command line analysis LLM call directly in the SOC environment.

大模型应用安全运营人机协作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。