arXiv:2509.20745cs.CV2025-09NeurIPS被引 7

用生成数据提升海上目标检测,尤其在罕见场景下表现更好。

Neptune-X: Active X-to-Maritime Generation for Universal Maritime Object Detection

  • 通过多模态生成模型合成逼真海景,捕捉物体与水域边界交互。
  • 动态选择与任务相关的合成样本,使检测准确率显著提升。
  • 适合做海上视觉系统、自动驾驶船舶研究者使用。

海上目标检测对航行安全、监控和自主作业至关重要,但受限于标注数据稀缺及跨属性(如类别、视角、位置、成像环境)泛化能力差。为此,我们提出Neptune-X,一种以数据为中心的生成-选择框架,通过任务感知的样本选择增强训练效果。从生成角度看,开发了多模态条件生成模型X-to-Maritime,合成多样化且真实的海景;其核心是双向物体-水面注意力模块,捕捉物体与水域边界的交互,提升视觉真实感。为提升下游任务性能,提出属性相关主动采样策略,根据任务相关性动态选择合成样本。为支持稳健评估,构建首个面向生成式海事学习的基准数据集——Maritime Generation Dataset,涵盖广泛语义条件。大量实验表明,该方法在海景合成上树立新标杆,显著提升检测精度,尤其在挑战性及此前未充分覆盖的场景中表现突出。代码已开源:https://github.com/gy65896/Neptune-X。

原文摘要 · Abstract (English)

Maritime object detection is essential for navigation safety, surveillance, and autonomous operations, yet constrained by two key challenges: the scarcity of annotated maritime data and poor generalization across various maritime attributes (e.g., object category, viewpoint, location, and imaging environment). To address these challenges, we propose Neptune-X, a data-centric generative-selection framework that enhances training effectiveness by leveraging synthetic data generation with task-aware sample selection. From the generation perspective, we develop X-to-Maritime, a multi-modality-conditioned generative model that synthesizes diverse and realistic maritime scenes. A key component is the Bidirectional Object-Water Attention module, which captures boundary interactions between objects and their aquatic surroundings to improve visual fidelity. To further improve downstream tasking performance, we propose Attribute-correlated Active Sampling, which dynamically selects synthetic samples based on their task relevance. To support robust benchmarking, we construct the Maritime Generation Dataset, the first dataset tailored for generative maritime learning, encompassing a wide range of semantic conditions. Extensive experiments demonstrate that our approach sets a new benchmark in maritime scene synthesis, significantly improving detection accuracy, particularly in challenging and previously underrepresented settings. The code is available at https://github.com/gy65896/Neptune-X.

目标检测生成模型海上应用数据增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。