arXiv:2601.09238cs.CV2026-01

用少量缺陷图生成真实可控的电力表计故障图像,提升检测性能。

Knowledge-Embedded and Hypernetwork-Guided Few-Shot Substation Meter Defect Image Generation Method

论文配图:Knowledge-Embedded and Hypernetwork-Guided Few-Shot Substation Meter Defect Image Generation Method
图 1 · 摘自论文原文
  • 结合知识嵌入与超网络控制,让扩散模型精准生成表计缺陷
  • 生成图像FID降低32.7%,下游检测mAP提升15.3%
  • 适合工业缺陷检测数据稀缺场景,生成结果可解释

变电站电表在电网稳定运行中至关重要,但其裂纹等物理缺陷的检测常受限于标注样本严重不足。为解决少样本生成难题,本文提出一种融合知识嵌入与超网络引导条件控制的Stable Diffusion框架,实现从有限数据中生成真实且可控的缺陷图像。首先,通过DreamBooth风格的知识嵌入微调预训练模型,编码电表独特的结构与纹理先验,缩小自然图像模型与工业设备间的领域差异。其次,设计几何裂纹建模模块,参数化缺陷的位置、长度、曲率和分支模式,生成像素级空间约束控制图。第三,构建轻量超网络,根据控制图与高级缺陷描述动态调节扩散模型的去噪过程,平衡生成保真度与可控性。在真实变电站电表数据集上的实验表明,该方法显著优于现有增强与生成基线:FID降低32.7%,多样性指标提升,且在使用增强数据训练后,下游缺陷检测器的mAP提升15.3%。该框架为缺陷样本稀缺的工业检测系统提供了高效高质量的数据合成方案。

原文摘要 · Abstract (English)

Substation meters play a critical role in monitoring and ensuring the stable operation of power grids, yet their detection of cracks and other physical defects is often hampered by a severe scarcity of annotated samples. To address this few-shot generation challenge, we propose a novel framework that integrates Knowledge Embedding and Hypernetwork-Guided Conditional Control into a Stable Diffusion pipeline, enabling realistic and controllable synthesis of defect images from limited data. First, we bridge the substantial domain gap between natural-image pre-trained models and industrial equipment by fine-tuning a Stable Diffusion backbone using DreamBooth-style knowledge embedding. This process encodes the unique structural and textural priors of substation meters, ensuring generated images retain authentic meter characteristics. Second, we introduce a geometric crack modeling module that parameterizes defect attributes--such as location, length, curvature, and branching pattern--to produce spatially constrained control maps. These maps provide precise, pixel-level guidance during generation. Third, we design a lightweight hypernetwork that dynamically modulates the denoising process of the diffusion model in response to the control maps and high-level defect descriptors, achieving a flexible balance between generation fidelity and controllability. Extensive experiments on a real-world substation meter dataset demonstrate that our method substantially outperforms existing augmentation and generation baselines. It reduces Frechet Inception Distance (FID) by 32.7%, increases diversity metrics, and--most importantly--boosts the mAP of a downstream defect detector by 15.3% when trained on augmented data. The framework offers a practical, high-quality data synthesis solution for industrial inspection systems where defect samples are rare.

缺陷检测图像生成少样本学习工业质检

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。