arXiv:2508.16239cs.CV2025-08中稿 · ECCV被引 3

首个大规模电子显微图像数据集,支持微观结构分割与生成。

EM3M: An Electron Micrograph Dataset for Microstructural Segmentation and Generation

  • 构建5091张高分辨率电镜图,含超300万实例标注。
  • 文本到图像扩散模型提升下游分割性能,验证合成数据有效性。
  • 适合材料科学自动化分析研究者使用。

定量微观结构表征是材料科学的基础,电子显微图像(EM)提供了不可或缺的高分辨率信息。然而,深度学习在电镜图像分析中的进展受限于大规模、专家标注的公开数据集稀缺。为此,我们提出EM3M,一个用于实例级理解的大型多模态数据集。EM3M包含5,091张高质量电镜图像、约300万实例分割标注以及带解耦属性的图像级文本描述。数据集通过严格的多阶段清洗与验证流程构建,并进行全面统计分析以确保可靠性和可复现性。基于这些图文对,我们进一步提供一个文本到图像扩散模型,作为可控数据增强引擎,实验表明合成数据能持续提升下游分割性能。为建立系统性基准,我们在EM3M上评估了代表性实例分割方法。结果表明,传统检测与查询式方法难以应对电镜中极端密集实例和纹理复杂性。我们还提供一个优化的流模型基线,以促进公平比较与未来研究。EM3M数据集、生成引擎及在线演示均已公开,支持自动化材料分析研究。

原文摘要 · Abstract (English)

Quantitative microstructural characterization is fundamental to materials science, and electron micrographs (EMs) provide indispensable high-resolution insights. However, progress in deep learning-based analysis of EMs has been hampered by the scarcity of large-scale, expert-annotated public datasets. To address this issue, we introduce EM3M, a large-scale and multimodal dataset for instance-level understanding of EMs. EM3M comprises 5,091 high-quality EMs, approximately 3 million instance segmentation annotations, and image-level textual descriptions with disentangled attributes. The dataset is constructed through a rigorous multi-stage curation and validation pipeline, with comprehensive statistical analyses to ensure reliability and reproducibility. Building upon these curated image-text pairs, we further provide a text-to-image diffusion model that serves as a controllable data augmentation engine, demonstrating that synthetic augmentation consistently improves downstream segmentation performance. To establish a systematic benchmark, we evaluate representative instance segmentation methods on EM3M. Our results reveal that conventional detection-based and query-based methods struggle with the extreme instance densities and textural complexities inherent in EMs. We additionally provide an optimized flow-based baseline to facilitate fair comparison and future research. EM3M {Dataset: https://huggingface.co/datasets/UniParser/EM3M}, the generative engine {Generation: https://huggingface.co/UniParser/EM3M-Gen}, and an online demo {Segmentation demo: https://www.bohrium.com/apps/uni-aims} are publicly available to support future research in automated materials analysis.

电子显微实例分割数据集生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。