arXiv:2410.21310cs.CVcs.GR2024-10ECCV

用3D结构自动给扫描电镜图像上色,一图着色即可全场景渲染。

ArCSEM: Artistic Colorization of SEM Images via Gaussian Splatting

  • 基于高斯点云建模三维结构,从单张着色图传播颜色到多视角。
  • 在1个着色视图条件下实现高质量新视角合成,保持细节真实。
  • 无需人工标注,适合科研人员快速生成彩色微观图像视频。

扫描电子显微镜(SEM)能捕捉微观物体表面的高分辨率灰度图像,但缺乏色彩信息。传统上需艺术家手动为多张图像着色,过程耗时。本文提出ArCSEM,利用微观场景的潜在3D结构,将少量着色视图的颜色信息传播至所有视角,实现全自动彩色化新视角合成。相比已有方法,本方案无需人工标注或干预即可获得3D表示,仅需1张或少数几张着色图像,即可自动生成完整彩色场景或视频。该方法通过多种场景表达技术验证,显著提升视觉表现力与效率。

原文摘要 · Abstract (English)

Scanning Electron Microscopes (SEMs) are widely renowned for their ability to analyze the surface structures of microscopic objects, offering the capability to capture highly detailed, yet only grayscale, images. To create more expressive and realistic illustrations, these images are typically manually colorized by an artist with the support of image editing software. This task becomes highly laborious when multiple images of a scanned object require colorization. We propose facilitating this process by using the underlying 3D structure of the microscopic scene to propagate the color information to all the captured images, from as little as one colorized view. We explore several scene representation techniques and achieve high-quality colorized novel view synthesis of a SEM scene. In contrast to prior work, there is no manual intervention or labelling involved in obtaining the 3D representation. This enables an artist to color a single or few views of a sequence and automatically retrieve a fully colored scene or video. Project page: https://ronly2460.github.io/ArCSEM

图像着色3D重建扫描电镜高斯点云

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。