用大模型自动生成文档伪造检测规则,提升安全验证效率。
Generation of Programmatic Rules for Document Forgery Detection Using Large Language Models
- 用真实场景数据微调大模型生成可执行的验证规则
- 在有限硬件上成功生成有效检测异常的程序代码
- 适合需要可解释性的安全敏感场景使用
文档伪造对法律、经济和政府流程构成日益严重的威胁,亟需更复杂的验证机制。一种方法是采用基于规则的合理性检查,评估数据的正确性与内部一致性以发现异常或篡改迹象。尽管这些检查对保障数据完整性至关重要,但现有规则均由工程师手动编写,耗时费力。近年来,大语言模型(LLMs)在代码生成方面的进展为自动化和规模化生成此类规则提供了新可能。然而,将LLM适配到未知领域仍面临重大挑战。本文研究了通过不同微调策略,在领域特定代码与数据上微调开源LLM(Llama 3.1 8B 和 OpenCoder 8B),在资源受限环境下生成用于伪造检测的规则化合理性检查的能力。我们使用来自真实应用场景的结构化数据集进行微调,并在先前未见的伪造模式上评估生成规则的有效性。结果表明,模型能够生成可执行且有效的验证程序。这凸显了LLM作为可扩展工具,在要求可解释性的安全敏感场景中辅助人类决策的巨大潜力。
原文摘要 · Abstract (English)
Document forgery poses a growing threat to legal, economic, and governmental processes, requiring increasingly sophisticated verification mechanisms. One approach involves the use of plausibility checks, rule-based procedures that assess the correctness and internal consistency of data, to detect anomalies or signs of manipulation. Although these verification procedures are essential for ensuring data integrity, existing plausibility checks are manually implemented by software engineers, which is time-consuming. Recent advances in code generation with large language models (LLMs) offer new potential for automating and scaling the generation of these checks. However, adapting LLMs to the specific requirements of an unknown domain remains a significant challenge. This work investigates the extent to which LLMs, adapted on domain-specific code and data through different fine-tuning strategies, can generate rule-based plausibility checks for forgery detection on constrained hardware resources. We fine-tune open-source LLMs, Llama 3.1 8B and OpenCoder 8B, on structured datasets derived from real-world application scenarios and evaluate the generated plausibility checks on previously unseen forgery patterns. The results demonstrate that the models are capable of generating executable and effective verification procedures. This also highlights the potential of LLMs as scalable tools to support human decision-making in security-sensitive contexts where comprehensibility is required.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。