用真实警民冲突对话训练小模型,实现低成本高逼真的警察情绪化解模拟。
DeEscalWild: A Real-World Benchmark for Automated De-Escalation Training with SLMs

- 从5000段真实视频中筛选1500个高保真警民对话场景,构建专用训练数据集。
- 微调后的30亿参数小模型在多个指标上超越通用大模型,计算成本仅为1/10。
- 适合需要低延迟、隐私保护的警务人员现场训练系统部署。
有效的情绪化解对执法安全与社区信任至关重要,但传统培训方法难以规模化且缺乏真实性。尽管大语言模型可生成动态开放的模拟对话,其高昂的计算开销使其无法在轻量便携的训练设备上部署。小语言模型(SLMs)虽具实时性优势,却面临高质量领域数据匮乏的问题。为此,我们提出DeEscalWild,一个基于多阶段流程的真实世界基准数据集,从公开视频库中提取警民互动原始素材。初始5000段输入经人机结合的混合过滤流程(含人类验证与LLM评判),最终获得1500个高保真情景,涵盖285,887轮对话,约470万词元。实验表明,基于该数据微调的SLMs在ROUGE-L、BLEU-4、METEOR、BERTScore、真实性评分及人工评估中显著优于基线模型。值得注意的是,在同等条件下,微调后的Qwen 2.5 (3B-Instruct) 性能超越通用的Gemini 2.5 Flash模型,证明领域优化的SLMs可在极低计算成本下实现更优表现。本工作为边缘部署的低延迟、隐私友好型警务培训系统奠定基础。代码与数据已公开:https://github.com/Hasebul/DeEscalWild-Benchmark-Framework,数据集链接:https://doi.org/10.7910/DVN/CWMCZI。
原文摘要 · Abstract (English)
Effective de-escalation is critical for law enforcement safety and community trust, yet traditional training methods lack scalability and realism. While Large Language Models (LLMs) enable dynamic, open-ended simulations, their substantial computational footprint renders them impractical for deployment on the lightweight, portable hardware required for immersive field training. Small Language Models (SLMs) offer a viable real-time alternative but suffer from a critical scarcity of high-quality, domain-specific training data. To bridge this gap, we present DeEscalWild, a novel benchmark dataset curated from a multi-stage pipeline of in-the-wild police-civilian interactions extracted from publicly available video repositories. Starting with 5,000 raw inputs, we employed a rigorous hybrid filtering process combining human-in-the-loop verification with LLM-as-a-Judge evaluation to distill 1,500 high-fidelity scenarios. The resulting corpus comprises 285,887 dialogue turns, totaling approximately 4.7 million tokens. Extensive experiments demonstrate that SLMs fine-tuned on this data significantly outperform their base counterparts across ROUGE-L, BLEU-4, METEOR, BERTScore, Realism Score, and human evaluation metrics. Notably, our fine-tuned Qwen 2.5 (3B-Instruct) surpasses the general-purpose Gemini 2.5 Flash model when evaluated under equivalent conditions, demonstrating that domain-optimized SLMs can achieve superior performance with a fraction of the computational cost. This work establishes the foundational infrastructure for accessible, low-latency, and privacy-preserving officer training systems at the edge. We publicly release our code(https://github.com/Hasebul/DeEscalWild-Benchmark-Framework) and dataset(https://doi.org/10.7910/DVN/CWMCZI).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。