arXiv:2505.14976cs.SEcs.AI2025-05被引 5

用深度学习自动识别日志中的敏感信息,准确率超99%。

SDLog: A Deep Learning Framework for Detecting Sensitive Information in Software Logs

  • 基于深度学习构建日志敏感信息检测框架,替代传统手工规则。
  • 仅需100个样本微调,就能识别99.5%的敏感字段,F1达98.4%。
  • 首次实现深度学习在日志匿名化中的应用,适合数据安全研究者。

软件日志记录系统运行时的关键事件与活动信息,在维护与运维中至关重要。然而,公开可获取的日志数据集仍十分有限,阻碍了日志分析研究的发展。日志中包含的个人身份信息(PII)和准标识符会带来严重的隐私泄露与重识别风险,导致真实日志难以共享。现有日志匿名化主要依赖正则表达式规则,需人工设计,存在工作量大、泛化能力差等问题。为此,本文提出SDLog——一种基于深度学习的日志敏感信息检测框架。实验表明,该方法克服了正则表达式的局限性,在目标数据集仅需100个微调样本的情况下,即可正确识别99.5%的敏感属性,达到98.4的F1分数。据我们所知,这是首个用于日志匿名化的深度学习替代方案。

原文摘要 · Abstract (English)

Software logs are messages recorded during the execution of a software system that provide crucial run-time information about events and activities. Although software logs have a critical role in software maintenance and operation tasks, publicly accessible log datasets remain limited, hindering advance in log analysis research and practices. The presence of sensitive information, particularly Personally Identifiable Information (PII) and quasi-identifiers, introduces serious privacy and re-identification risks, discouraging the publishing and sharing of real-world logs. In practice, log anonymization techniques primarily rely on regular expression patterns, which involve manually crafting rules to identify and replace sensitive information. However, these regex-based approaches suffer from significant limitations, such as extensive manual efforts and poor generalizability across diverse log formats and datasets. To mitigate these limitations, we introduce SDLog, a deep learning-based framework designed to identify sensitive information in software logs. Our results show that SDLog overcomes regex limitations and outperforms the best-performing regex patterns in identifying sensitive information. With only 100 fine-tuning samples from the target dataset, SDLog can correctly identify 99.5% of sensitive attributes and achieves an F1-score of 98.4%. To the best of our knowledge, this is the first deep learning alternative to regex-based methods in software log anonymization.

日志安全深度学习隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。