arXiv:2511.00362cs.CVcs.AI2025-11被引 2

用街景图秒建3D文物模型,零成本拯救濒危遗产

Oitijjo-3D: Generative AI Framework for Rapid 3D Heritage Reconstruction from Street View Imagery

  • 两阶段AI流程:先用Gemini合成纹理,再用Hexagen生成几何
  • 秒级完成高保真重建,速度远超传统方法
  • 适合资源匮乏地区,让普通人也能参与文化保护

孟加拉国文化遗产修复面临资源有限与技术人才短缺的双重挑战。传统3D数字化方法如摄影测量或激光扫描需昂贵设备、专业人员及实地作业,常在发展中国家难以实施。因此,从巴哈普尔佛寺到阿汗·曼济尔等众多建筑仍面临衰败风险且缺乏数字存档。本文提出Oitijjo-3D,一个免费的生成式AI框架,利用公开的Google街景影像,通过两阶段流程——基于Gemini 2.5 Flash Image的多模态视觉推理实现结构-纹理合成,结合Hexagen进行神经图像到3D的几何恢复——在数秒内生成具有度量一致性的照片级真实感模型,无需专用硬件或专家干预。在阿汗·曼济尔、乔托苏纳清真寺和巴哈普尔等地标上的实验表明,该系统在保持视觉与结构真实性的同时,极大降低了经济与技术门槛。本工作将开放影像转化为数字遗产,使保护成为资源有限国家中的社区化、AI辅助的文化延续行动。

原文摘要 · Abstract (English)

Cultural heritage restoration in Bangladesh faces a dual challenge of limited resources and scarce technical expertise. Traditional 3D digitization methods, such as photogrammetry or LiDAR scanning, require expensive hardware, expert operators, and extensive on-site access, which are often infeasible in developing contexts. As a result, many of Bangladesh's architectural treasures, from the Paharpur Buddhist Monastery to Ahsan Manzil, remain vulnerable to decay and inaccessible in digital form. This paper introduces Oitijjo-3D, a cost-free generative AI framework that democratizes 3D cultural preservation. By using publicly available Google Street View imagery, Oitijjo-3D reconstructs faithful 3D models of heritage structures through a two-stage pipeline - multimodal visual reasoning with Gemini 2.5 Flash Image for structure-texture synthesis, and neural image-to-3D generation through Hexagen for geometry recovery. The system produces photorealistic, metrically coherent reconstructions in seconds, achieving significant speedups compared to conventional Structure-from-Motion pipelines, without requiring any specialized hardware or expert supervision. Experiments on landmarks such as Ahsan Manzil, Choto Sona Mosque, and Paharpur demonstrate that Oitijjo-3D preserves both visual and structural fidelity while drastically lowering economic and technical barriers. By turning open imagery into digital heritage, this work reframes preservation as a community-driven, AI-assisted act of cultural continuity for resource-limited nations.

3D重建文化遗产生成式AI街景影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。