arXiv:2608.30727cs.CVcs.AI2026-08

用生成模型合成铁路小异物,提升罕见目标检测效果。

RailGen: Improving Railway Intrusion Detection via Agent-Guided Small-Scale Foreign Object Generation

论文配图:RailGen: Improving Railway Intrusion Detection via Agent-Guided Small-Scale Foreign Object Generation
图 1 · 摘自论文原文
  • 构建多模态生成代理,自动合成逼真小异物图像。
  • 生成样本使小物体像素面积缩小58倍,平均13.85倍。
  • 适合铁路安全等高风险场景的小目标检测任务。

长尾数据分布下的小目标检测是多媒体领域的基础难题。铁路异物检测(RFOD)典型地面临易混淆的小型入侵物和样本稀缺问题。为此,我们提出一种生成增强检测范式,利用多模态图像生成丰富稀有与小型目标的特征空间。首先构建基于大模型的多模态图像生成代理RailGen。在语义约束下,RailGen可自动调用工具生成铁路场景,校准异物位置,提取异物并融合为真实感侵入效果。该过程生成高质量合成样本,有效稠密化尾部类别特征表示,完善小目标特征空间。在此范式下,进一步提出FocalDEIM检测框架,通过焦点调制实现更优密集匹配,结合焦点损失强调难样本,缓解复杂铁路场景中类间边界模糊问题。实验表明,RailGen可生成高质量小规模异物,使对象像素面积平均减少13.85倍,最大缩小58倍。搭载这些挑战性样本后,本范式在mAP@50和mAP@(50-95)上分别较基线DEIM提升5.6%和7.5%,超越现有最先进方法。消融实验验证了RailGen的特征空间扩展能力与FocalDEIM的边界区分能力。该范式为安全关键应用中的长尾小目标检测提供了有效的多模态生成解决方案。

原文摘要 · Abstract (English)

Small-object detection under long-tailed data distributions is a fundamental yet challenging problem in multimedia. Railway Foreign Object Detection (RFOD) epitomizes this challenge with easily confused small intrusions and scarce samples. To address these issues, we propose a generative-augmented detection paradigm that leverages multimodal image generation to enrich the feature space of rare and small objects. We first construct RailGen, a multimodal image generation agent based on large models. Under semantic constraints, RailGen automatically invokes tools to generate railway scenes, calibrate intrusion positions, extract foreign objects, and fuse them into realistic intrusion effects. This process produces high-quality synthetic samples that effectively densify the feature representations of tail classes and complete the small-object feature space. Within this paradigm, we further propose FocalDEIM, a detection framework designed to enhance training with generated data. FocalDEIM improves dense matching with Focal Modulation for better small-object discrimination and adopts Focal Loss to emphasize hard samples, thereby alleviating blurred inter-class boundaries in complex railway scenes. Experimental results demonstrate that RailGen can generate high-quality small-scale foreign objects, reducing the object pixel area by up to 58x and 13.85x on average. Equipped with these challenging samples, our paradigm surpasses the baseline DEIM by 5.6% and 7.5% in mAP@50 and mAP@(50-95), respectively, and outperforms existing state-of-the-art methods. Ablation studies verify RailGen's feature-space enrichment and FocalDEIM's boundary discrimination. The paradigm provides an effective multimodal generative solution for long-tailed small-object detection in safety-critical applications.

小目标检测生成模型铁路安全长尾分布

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。