arXiv:2608.09691cs.CV2026-08中稿 · the Curated Data f…

用少量现场照片生成带标注的训练数据,提升目标检测在新场景下的泛化能力。

Diffuse the object, keep its label: curating detector training data from a few unlabeled photographs via VLM-built 3D vegetation scenes

论文配图:Diffuse the object, keep its label: curating detector training data from a few unlabeled photographs via VLM-built 3D vegetation scenes
图 1 · 摘自论文原文
  • 通过视觉语言模型构建3D植被场景,自动合成带标注的训练图像。
  • 轻量微调扩散模型,控制纹理修改程度,提升小目标召回率。
  • 仅需几张现场照片即可实现跨场景自适应,适合资源受限的实地应用。

小物体在植被中被遮挡的标注图像稀缺,导致检测器在不同地点泛化能力差。本文不依赖其他地点的标签,而是利用部署现场的少数未标注照片,合成带标注的训练图像。一个视觉-语言模型从一张照片生成粗粒度3D植被场景;将3D物体网格放置其中,可直接由场景几何体生成边界框、分割掩码和实例级遮挡信息,无需人工标注。一个轻量级适配器在照片上微调,控制扩散过程以重绘渲染图像,分级掩码锁(mask-lock)决定扩散对物体本身的扰动程度。实验表明,该等级是影响数据筛选最关键的因素:适度扩散物体可提升少数类召回率,而完全保护或无限制扩散则分别导致性能下降或物体消失。在人道主义排雷基准测试中,使用这些合成图像训练的标准检测器,在不同随机种子下均达到或超过使用更大规模真实标注数据集(来自另一地点)训练的模型性能,实现了仅需少量照片的无监督跨站点自适应,相比传统跨站点标签复用更具优势。消融实验显示性能增益对照片数量和裁剪预算不敏感,且域内准确率无法预测跨站点表现。

原文摘要 · Abstract (English)

Labeled images of small objects hidden in vegetation are scarce, and detectors trained on them generalize poorly across sites. Rather than reusing labels collected at another site, we synthesize labeled training images from a handful of unlabeled photographs of the deployment site itself. A vision--language model generates a coarse 3D vegetation scene from one photograph; placing 3D object meshes in the scene yields bounding boxes, segmentation masks, and per-instance occlusion directly from the scene geometry, without manual annotation. A lightweight adapter fine-tuned on the photographs conditions a diffusion pass that re-textures the renders, and a graded mask-lock sets how much diffusion may touch the object itself. In our runs this grade was the most influential curation choice: lightly diffusing the object improves minority-class recall over fully protecting its pixels, while unrestricted diffusion dissolves it. Trained on these images, a standard detector matched or exceeded its counterpart trained on a larger labeled dataset of real images from a different site, consistently across seeds on a humanitarian-demining benchmark; the comparison is thus unsupervised site adaptation from a handful of photographs against conventional cross-site label reuse. In our ablations the gains were largely insensitive to the photograph and crop budgets, and in-domain accuracy did not predict cross-site performance.

目标检测数据合成跨域适应扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。